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Abstract. We propose strongly consistent algorithms for reconstructing the characteristic 
function Ik of an unknown convex body K in R" from possibly noisy measurements of the 
modulus of its Fourier transform 1^. This represents a complete theoretical solution to the 
Phase Retrieval Problem for characteristic functions of convex bodies. The approach is via 
the closely related problem of reconstructing K from noisy measurements of its covariogram, 
I— I the function giving the volume of the intersection of K with its translates. In the many 

known situations in which the covariogram determines a convex body, up to reflection in the 
origin and when the position of the body is fixed, our algorithms use 0{k'^) noisy covariogram 
i measurements to construct a convex polytope Pk that approximates K or its reflection —K 

in the origin. (By recent uniqueness results, this applies to all planar convex bodies, all three- 
dimensional convex polytopes, and all symmetric and most (in the sense of Baire category) 
arbitrary convex bodies in all dimensions.) Two methods are provided, and both are shown 
I— I to be strongly consistent, in the sense that, almost surely, the minimum of the Hausdorff 

distance between and ±K tends to zero as k tends to infinity. 

> 

^ 1. Introduction 

00 

^ The Phase Retrieval Problem of Fourier analysis involves determining a function / on M" 

^ from the modulus | / | of its Fourier transform /. This problem arises naturally and fre- 
quently in various areas of science, such as X-ray crystallography, electron microscopy, optics, 
O astronomy, and remote sensing, in which only the magnitude of the Fourier transform can 
be measured and the phase is lost. (Sometimes, as when reconstructing an object from its 
• ^ far-field diffraction pattern, it is the squared modulus |/p that is directly measured.) In 
^ 1984, Rosenblatt ^42j wrote that the Phase Retrieval Problem "arises in all experimental uses 
of diffracted electromagnetic radiation for determining the intrinsic detailed structure of a 
diffracting object." Today, the word "all" is perhaps too strong in view of recent advances in 
coherent diffraction imaging. In any case, the literature is vast; see the surveys [32], [3l], [36] . 
and |l2], as well as the articles [9j and '^L8\ and the references given there. 

Phase retrieval is fundamentally under-determined without additional constraints, which 
usually take the form of an a priori assumption that / has a particular support or distribution 
of values. An important example is when / = Ix, the characteristic function of a convex 
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body K in M". In this setting, phase retrieval is very closely related to a geometric problem 
involving the covariogram of a convex body K in M". This is the function qk defined by 

gK{x) = Vn{Kn{K + x)), 

for X e M", where Vn denotes n-dimensional Lebesgue measure and K + x is the translate 
of K by the vector x. It is also sometimes called the set covariance and is equal to the 
autocorrelation of Ik, that is, 

where * denotes convolution and —K is the reflection of K in the origin. Taking Fourier 
transforms, we obtain the relation 

(1) QK = 1-A' = Ix lii' = I li^ I • 

This connects the Phase Retrieval Problem, restricted to characteristic functions of convex 
bodies, to the problem of determining a convex body from its covariogram. Both the definition 
of covariogram and this connection extend to arbitrary measurable sets, but the reason for 
restricting to convex bodies will become clear. 

The covariogram was introduced by Matheron in his book [38] on random sets. He showed 
that for a fixed u G 5*"^^, the directional derivatives dgKitu)/dt, for all t > 0, of the co- 
variogram of a convex body K in M" yield the distribution of the lengths of all chords of K 
parallel to u. This explains the utility of the covariogram in fields such as stereology, geomet- 
ric tomography, pattern recognition, image analysis, and mathematical morphology, where 
information about an unknown object is to be retrieved from chord length measurements; see, 
for example, [T3], [20], and [13]. The covariogram has also played an increasingly important 
role in analytic convex geometry. For example, it was used by Rogers and Shephard in proving 
their famous difference body inequality (see [Ml Theorem 7.3.1]), by Gardner and Zhang [26] 
in the theory of radial mean bodies, and by Tsolomitis [17] in his study of convolution bodies, 
which via the work of Schmuckenschlager [H] and Werner [50] allows a covariogram-based 
definition of the fundamental notion of affine surface area. 

Here we effectively solve the following three problems. In each, K is a convex body in M". 
Problem 1 (Reconstruction from covariograms) . Construct an approximation to K 
from a finite number of noisy (i.e., taken with error) measurements of qk- 
Problem 2 (Phase retrieval for characteristic functions of convex bodies: squared 
modulus). Construct an approximation to K (or, equivalently, to Ik) from a finite number 
of noisy measurements of \1k\^- 

Problem 3 (Phase retrieval for characteristic functions of convex bodies: mod- 
ulus). Construct an approximation to K from a finite number of noisy measurements of 

M- 

In order to discuss our results, we must first address the corresponding uniqueness problems. 
In view of ([T]), these are equivalent, so we shall focus on the covariogram. It is easy to see 
that qk is invariant under translations of K and reflection of K in the origin. Matheron [10] 
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asked the following question, known as the Covariogram Problem^ to which he conjectured an 
affirmative answer when n = 2. 

Is a convex body in M" determined, among all convex bodies and up to translation and 
reflection in the origin, by its covariogram? 

The focus on covariograms of convex bodies is natural. One reason is that Mallows and 
Clark [37] constructed non-congruent convex polygons whose overall chord length distributions 
(allowing the directions of the chords to vary as well) are equal, thereby answering a related 
question of Blaschke. Thus the information provided by the covariogram cannot be weakened 
too much. Moreover, there exist non-congruent non-convex polygons, even (see \12\ p. 394]) 
horizontally- and vertically-convex polyominoes, with the same covariogram, indicating that 
the convexity assumption also cannot be significantly weakened. 

Interest in the Covariogram Problem extends far beyond geometry. For example, Adler and 
Pyke ^ ask whether the distribution of the difference X — Y oi independent random variables 
X and y, uniformly distributed over a convex body determines K up to translations 
and reflection in the origin. Up to a constant, the convolution Ik * ^-k = Qk is just the 
probability density of X — y, so the question is equivalent to the Covariogram Problem. In 
P], the Covariogram Problem also appears in deciding the equivalence of measures induced 
by Brownian processes for different base sets. 

A detailed historical account of the covariogram problem may be found in [4J . The current 
status is as follows, in which "determined" always means determined by the covariogram 
among all convex bodies, up to translation and reflection in the origin. Averkov and Bianchi [1] 
showed that planar convex bodies are determined, thereby confirming Matheron's conjecture. 
Bianchi [8J proved, by a long and intricate argument, that three-dimensional convex polyhedra 
are determined. It is easy to see that centrally symmetric convex bodies are determined. (In 
the symmetric case, convexity is not essential; see |22l Proposition 4.4] for this result, due to 
Cabo and Jensen.) Goodey, Schneider, and Weil [21] proved that most (in the sense of Baire 
category) convex bodies in M" are determined. Nevertheless, the Covariogram Problem in 
general has a negative answer, as Bianchi [7] demonstrated by constructing convex polytopes 
in M", n > 4, that are not determined. It is still unknown whether convex bodies in are 
determined. 

None of the above uniqueness proofs provide a method for actually reconstructing a convex 
body from its covariogram. We are aware of only two papers dealing with the reconstruction 
problem: Schmitt [13] gives an explicit reconstruction procedure for a convex polygon when 
no pair of its edges are parallel, an assumption removed in an algorithm due to Benassi and 
D'Ercole [6]. In both these papers, all the exact values of the covariogram are supposed to be 
available. 

In contrast, our first set of algorithms take as input only a finite number of values of the 
covariogram of an unknown convex body Kq. Moreover, these measurements are corrupted by 
errors, modeled by zero mean random variables with uniformly bounded pth moments, where 
p is at most six and usually four. It is assumed that Kq is determined by its covariogram, 
has its centroid at the origin, and is contained in a known bounded region of M", which for 
convenience we take to be the unit cube Cq = [—1/2, 1/2]". We provide two different methods 
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for reconstructing, for each suitable A; G N, a convex polytope Pk that approximates Kq or 
its reflection —Kq. Each method involves two algorithms, an initial algorithm that produces 
suitable outer unit normals to the facets of P^, and a common main algorithm that goes on 
to actually construct Pk- 

In the first method, the covariogram of Kq is measured, multiple times, at the origin and 
at vectors {l/k)ui, i = l,...,k, where the m^'s are mutually nonparallel unit vectors that 
span M". From these measurements, the initial Algorithm NoisyCovBlaschke constructs an 
o-symmetric convex polytope Qk that approximates VKq, the so-called Blaschke body of 
Kq. (See Section |3] for definitions and notation.) The crucial property of VKq is that when 
Ko is a convex polytope, each of its facets is parallel to some facet of VKq. It follows 
that the outer unit normals to the facets of Pk can be taken to be among those of Qk- 
Algorithm NoisyCovBlaschke utilizes the known fact that —dgKo{tu)/dt, evaluated at t = 0, 
equals the brightness function value bKo{u), that is, the {n — l)-dimensional volume of the 
orthogonal projection of Kq in the direction u. This connection allows most of the work to be 
done by a very efficient algorithm. Algorithm NoisyBrightLSQ, designed earlier by Gardner 
and Milanfar (see [21]) for reconstructing a o-symmetric convex body from finitely many noisy 
measurements of its brightness function. 

The second method achieves the same goal with a quite different approach. This time the 
covariogram of Kq is measured once at each point in a cubic array in 2Cg = [—1, 1]" of side 
length 1/k. From these measurements, the initial Algorithm NoisyCovDiff((y9) constructs an 
o-symmetric convex polytope Qk that approximates DKq = Ko + {—Kq), the difference body 
of Kq. The set DKq has precisely the same property as VKq, that when Kq is a convex poly- 
tope, each of its facets is parallel to some facet of DKq. Furthermore, DKq is just the support 
of gxo- The known property that g]l^ is concave (a consequence of the Brunn-Minkowski 
inequality [2T1 Section 11]) can therefore be combined with techniques from multiple regres- 
sion. Algorithm NoisyCovDiff(<^) employs a Gasser-Miiller type kernel estimator for g^o, with 
suitable kernel function (f, bandwidth, and threshold parameter. 

The output Qk of either initial algorithm forms part of the input to the main common Al- 
gorithm NoisyCovLSQ. The covariogram of Kq is now measured again, once at each point in a 
cubic array in 2Cq = [—1, 1]" of side length 1/k. Using these measurements. Algorithm Noisy- 
CovLSQ finds a convex polytope Pk, each of whose facets is parallel to some facet of Qk, whose 
covariogram fits best the measurements in the least squares sense. 

Much effort is spent in proving that these algorithms are strongly consistent. Whenever 
Kq is determined among convex bodies, up to translation and reflection in the origin, by its 
covariogram, we show that, almost surely, 

mm{6{KQ,Pk),Si-KQ,Pk)} ^ 

as — )• oo, where S denotes Hausdorff distance. (If Kq is not so determined, a rare situation 
in view of the uniqueness results discussed above, the algorithms still construct a sequence 
(Pk) whose accumulation points exist and have the same covariogram as Kq.) From a theo- 
retical point of view, this completely solves Problem 1. Naturally, the consistency proof leans 
heavily on results and techniques from analytic convex geometry, as well as a suitable version 
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of the Strong Law of Large Numbers. Some effort has been made to make the proof fairly 
self-contained, but some arguments from the proof from [24j that Algorithm NoisyBrightLSQ 
is strongly consistent are used in proving that Algorithm NoisyCovBlaschke is strongly con- 
sistent. One such argument rests on the Bourgain-Campi-Lindenstrauss stability result for 
projection bodies. 

With algorithms for Problem 1 in hand, we move to Problem 2, assuming that Kq is an un- 
known convex body satisfying the same conditions as before. The basic idea is simple enough: 
Use and the measurements of |lxoP cit points in a suitable cubic array to approximate qk^ 
via its Fourier series, and feed the resulting values into the algorithms for Problem 1. How- 
ever, two major technical obstacles arise. The new estimates of qkq are corrupted by noise 
that now involves dependent random variables, and a new deterministic error appears as well. 
A substitute for the Strong Law of Large Numbers must be proved, and the deterministic 
error controlled using Fourier analysis and the fortunate fact that is Lipschitz. In the 
end the basic idea works, assuming that for suitable 1/2 < 7 < 1, measurements of IIkqP 
are taken at the points in {l/k"')'L^ contained in the cubic window \—k^~"', k}~"'Y, whose size 
increases with at a rate depending on the parameter 7. The three resulting algorithms. Al- 
gorithm NoisyMod^LSQ, Algorithm NoisyMod^Blaschke, and Algorithm Noisy Mod^Diff((y9), 
are stated in detail and, with suitable restrictions on 7, proved to be strongly consistent under 
the same hypotheses as for Problem 1. 

Our final three algorithms. Algorithm NoisyModLSQ, Algorithm NoisyModBlaschke, and 
Algorithm NoisyModDiff((y9) cater for Problem 3. Again there is a basic simple idea, namely, 
to take two independent measurements at each of the points in the same cubic array as in 
the previous paragraph, multiply the two, and feed the resulting values into the algorithms 
for Problem 2. No serious extra technical difficulties arise, and we are able to prove that 
the three new algorithms are strongly consistent under the same hypotheses as for Problem 2. 
This provides a complete theoretical solution to the Phase Retrieval Problem for characteristic 
functions of convex bodies. 

To summarize: 

• For Problem 1, first use ezi/ier Algorithm NoisyCovBlaschke or Algorithm NoisyCovDiff((y9) 
and then use Algorithm NoisyCovLSQ. 

• For Problem 2, first use ezt/ier Algorithm NoisyMod^Blaschke or Algorithm NoisyMod^Diff((y9) 
and then use Algorithm NoisyMod^LSQ. 

• For Problem 3, first use ezi/ier Algorithm NoisyModBlaschke or Algorithm NoisyModDiff(93) 
and then use Algorithm NoisyModLSQ. 

These results can also be viewed as a contribution to the literature on the associated unique- 
ness problems. They show that if a convex body is determined, up to translation and reflection 
in the origin, by its covariogram, then it is also so determined by its values at certain countable 
sets of points, even, almost surely, when these values are contaminated with noise. Similarly, 
the characteristic function of such a convex body is also determined by certain countable sets 
of noisy values of the modulus of its Fourier transform. 
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Our noise model is sufficiently general to apply to all the main cases of practical interest: 
zero mean Gaussian noise, Poisson noise (unbiased measurements following a Poisson distribu- 
tion, sometimes called shot noise), or Poisson noise plus zero mean Gaussian noise. However, 
the main text of this paper deals solely with theory. With the exception of Corollary |6.5 



and Remark |6.6[ where the method of proof leads naturally to rates of convergence for Al- 
gorithm NoisyCovDiff(y)) and hence for the two related algorithms for phase retrieval, the 
focus is entirely on strong consistency. Further remarks about convergence rates, sampling 
designs, and implementation issues have been relegated to the Appendix. Much remains to 
be done. We believe, however, that our algorithms will find applications. For example, Baake 
and Grimm [5] explain how the problem of finding the atomic structure of a quasicrystal 
from its X-ray diffraction image involves recovering a subset of MJ^ called a window from its 
covariogram, and note that this window is in many cases a convex body. 

We are grateful to Jim Fienup, David Mason, and Sara van de Geer for helpful correspon- 
dence and to referees for some insightful suggestions that led to significant improvements. 

2. Guide to the paper 

f|3| Definitions, notation, and preliminary results. 

We recommend that the reader skip this section and refer back to it when necessary. 
^ The main algorithm for reconstruction from covariograms. 

This presents the main [second stage) Algorithm NoisyCovLSQ for Problem 1 and 



its strong consistency, established in Theorem 4.10 
Approximating the Blaschke body via the covariogram. 

The ffist of the two ffist-stage algorithms for Problem 1, Algorithm NoisyCov- 



6.4 



Blaschke, is stated with proof of strong consistency in Theorem 5.4 The latter 
requires the assumption that the vectors Ui, i = 1, . . . ,k, are part of an infinite se- 
quence (ui) that is in a sense evenly spread out in S*""^, but this is a weak restriction. 

^ Approximating the difference body via the covariogram. 

In this section, the second of the two ffist-stage algorithms for Problem 1, Algo- 
rithm NoisyCovDiff(<^), is set out and proved to be strongly consistent in Theorem 

^ Phase retrieval: Framework and technical lemmas. 

Necessary material from Fourier analysis is gathered, and the scene is set for results 
on phase retrieval. This does not depend on the previous three sections. 

^ Phase retrieval from the squared modulus. 

The algorithms for Problem 2, Algorithm NoisyMod^LSQ, Algo- 
rithm NoisyMod^Blaschke, and Algorithm NoisyMod^Diff((y9) are presented and 
strong consistency theorems for them are proved. 

S|9| Phase retrieval from the modulus. 

The corresponding algorithms for Problem 3, Algorithm NoisyModLSQ, Algo- 
rithm NoisyModBlaschke, and Algorithm NoisyModDiff (</?), are presented and shown 
to be strongly consistent. 
^ 10 Appendix. 

Rates of convergence and implementation issues are discussed. 
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3. Definitions, notation, and preliminary results 

3.1. Basic definitions and notation. As usual, 5*""^ denotes the unit sphere, -B" the unit 
ball, o the origin, and | ■ | the norm in Euclidean ra-space M". It is assumed throughout that 
n > 2. We shall also write Cg = [—1/2,1/2]" throughout. The standard orthonormal basis 
for will be denoted by {ei, . . . ,e„}. A direction is a unit vector, that is, an element of 
S'^~^ . If M is a direction, then is the in — l)-dimensional subspace orthogonal to u and 1^ 
is the line through the origin parallel to u. If x,?/ G M", then x ■ y vs, the inner product of x 
and y, and [x, y\ is the line segment with endpoints x and y. 

We denote by dA^ int A, diamA, and \a the boundary, interior, diameter, and characteristic 
function of a set A, respectively. The notation for the usual (orthogonal) projection of A on a 
subspace S is A\S. A set is o-symmetric if it is centrally symmetric, with center at the origin. 

If X is a metric space and e > 0, a. finite set {xi, . . . , Xm} is called an e-net in X if for every 
point X in X, there is an i G {1, . . . ,m} such that x is within a distance e of Xi. 

We write Vk for fc-dimensional Lebesgue measure in M", where k = 1, . . . ,n, and where we 
identify Vk with fc- dimensional Hausdorff measure. If is a fc-dimensional convex subset of 
M", then V{K) is its volume Vk{K). Define = V{B"). The notation dz will always mean 
dVk{z) for the appropriate k = 1, . . . ,n. 

If E and F are sets in M", then 

E + F = {x + y : X e E,y e F} 
denotes their Minkowski sum and 

(2) EeF = {x eMP : F + x C E} 

their Minkowski difference. 

We adopt a standard definition of the Fourier transform / of a function / on M", namely 

f{x)= [ f{y)e-''-'dy. 

If / and g are real- valued functions on N, then, as usual, f = 0{g) means that there is a 
constant c such that f{k) < cg{k) for sufficiently large k. The notation f ^ g will mean that 
f = 0{g) and^7 = 0(/). 

3.2. Convex geometry. Let /C" be the class of compact convex sets in M", and let 1C^{A) 
be the subclass of members of /C" contained in the subset A of M". A convex body in M" is a 
compact convex set with nonempty interior. The notation JC^lr, R) will be used for the class 
of convex bodies containing ri?" and contained in RB"^, where < r < R. The treatise of 
Schneider [46j is an excellent general reference for convex geometry. 

Figures illustrating many of the following definitions can be found in |20] . 
If K G /C", then 

K* = {x ■.x-y<lhT all y e K} 
is the polar set of K. The function 

hxix) = max{a; ■ y : y & K}, 
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for x G M", is the support function of K and 

bM = V{K\u^), 

for u G 5*"^^ its brightness function. Any G /C" is uniquely determined by its support 
function. We can regard hx as a function on S*""^, since hxix) = \x\hK{x/\x\) for x ^ a. The 
Hausdorff distance 6{K, L) between two sets K,L & /C" can then be conveniently defined by 

6{K,L) = Whx - hiWoo, 

where || ■ ||oo denotes the supremum norm on S"'~^. Equivalently, one can define 

6{K, L) = mm{e > : K C L + Lc K + eS"}. 

The surface area measure S{K, ■) of a convex body K is defined for Borel subsets E of S^~^ 

by 

S{K,E) = Vn-i {g-\K,E)), 

where g~^{K,E) is the set of points in dK at which there is an outer unit normal vector in 
E. Let S{K) = S{K,S''-^). Then S{K) is the surface area of K. The Blaschke body VK of 
a convex body K is the unique o-symmetric convex body satisfying 

(3) s{yK,.) = \s{Kr) + \s{-K,.). 

The projection body oi K E /C" is the o-symmetric set UK G /C" defined by 

(4) hiiK = bx- 
Cauchy's projection formula states that for any u G S^~^, 

(5) huKiu) = bK{u) = ]- I \u- v\dS{K,v), 
and Cauchy's surface area formula is 

(6) SiK) = — [ bK{u)du- 

see [201 (A.45) and (A.49), p. 408]. By Q and Q, we have 

(7) b^K = bx, 

and it can be shown (see [20, p. 116]) that VK is the unique o-symmetric convex body with 
this property. 

The difference body of K is the o-symmetric convex body DK = K + {—K). 
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3.3. The covariogram. The function 

gK{x) = V{Kn{K + x)), 

for X G M", is caUed the covariogram of K. Note that gxio) = V{K), and that we have 
gK{x) = if and only if x ^ int DK, so the support of gK is DK. Also, g]l"' is concave on its 
support; see, for example, [261 Lemma 3.2]. 

Let K he a convex body in and let u G S""^^. The (parallel) X-ray of K in the direction 
u is the function X^K defined by 



XuK{x) = / lK{y)dy, 

J lu+X 

for X G Now define 

(8) EK{t, u) = {yeu^: X^K{y) > t} 
and 

(9) aKit,u) = V{EKit,u)), 

for t > and u G ^""^ Note that if u G then EKiO,u) = K\u^ and a/^(0,M) = bxiu). 

Let X = tu, where t > and m G 5*""^, and define u) = gxitu). The simple relationship 

POO 

(10) gj^{t,u) = / aK{s,u)ds 



aK{t,u), 



was noticed by Matheron [SS^, p. 86] in the form 

dgK{t,u) _ _ 
dt 

which also yields 

dgKit,u) 



dt 



-bxiu). 



(Note that the partial derivative here is one-sided; gx is not differentiable at the origin.) 
Lemma 3.1. Let r > and let K be a convex body with rB^ G K . If < t < 2r, then 

(n\ ^ V \ f \ ^ 9k{.o) - QKitu) 

(11) V 2^ j - ~t ' 

for all u G S''-^ . 

Proof. Let u G 5""-"^ By ([To]), we have 



9k{o) - gK{tu) = / aK{s,u)ds 
Jo 



From this and the fact that aK{-,u) is decreasing, we obtain 

(12) aK{t,u) < < aK{0,u) = bK\u). 
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The set 

M = conv [{K\u'^) U [—ru^ru\) 
is generally not a subset of but elementary geometry using [— rw, ru] C K and ([s]) gives 

1-:^ 1 [K\u^] =EMit,u) cEkU^u) 



2r 



^ {K\u^) =EMit,u) C 



Taking the {n — l)-dimensional volumes of these sets and using ^ yields 



t ' 



1 - ^ ) bxiu) < aK{t,u). 



The lemma follows from the previous inequality and (12). □ 



An inequality similar to (11) was derived in [331 Theorem 1] for n = 2. 

Matheron [ICTl p. 2] showed that the covariogram of a convex body is a Lipschitz function. 
For the convenience of the reader, we provide a proof of this fact based on [12] , which yields 
the optimal Lipschitz constant. 

Proposition 3.2. If K is a convex body in M" and x,y E W^, then 

\gK{x) - gK{y)\ < max bK{u)\x - y\. 

Proof. We have 

{Kr]{K + x)) \{Kn{K + y)) c{K + x)\{K + y). 

This implies 

Vn{Kr\{K + x))-Vn{Kn{K + y)) < Vn{K \ {K + y - x)) 

= Vn{K)-Vn{Kn{K + y-x)). 

Equivalently, gK{x) - gxiy) < gxio) - gxiy - x) = gxio) - gxix -y), and interchanging x 
and y yields 

\gK{x) - gK{y)\ < gM - gxix - y). 



Using this and the right-hand inequality in (11), we get 

\gK{x) - gK{y)\ < bKi ] T ]\x-y\ 



\x - y\ 

and the proposition follows immediately. □ 
Corollary 3.3. If Kq C Cq is a convex body, then for all x,y E M"', 

\9Ko{x) - gKo{y)\ < Vn\x - y\. 
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Proof. Since Kq C Cq, Proposition 3.2 yields 

Igxix) - gxiy)] < max bcr^{u)\x - y\. 

By Cauchy's projection formula ([s]), for u = {ui,U2, ■ ■ ■ ,Un) G S*""^ we have 

n 

bcs{u) = V{CS\u^)=Y, 



n 



i=l 



from which it is easy to see that hcj^ (u) < y/n. □ 

3.4. Miscellaneous definitions. Let fi and u be finite nonnegative Borel measures in 5*""^. 
Define 

(13) dp{fx, u) = mi{e > : fi{E) < u{E,) + e, u{E) < fi{E,) +e, E Borel in 5"-^}, 
where 

E, = {ue 5"-^ ■.3v e E -.lu-v] < e}. 

Then dp is a metric called the Prohorov metric. As S""^ is a Polish space, it is enough to 
take the infimum in (13) over the class of closed sets. In addition, if /i(S'"~^) = //(S"""^), then 

(14) dp{i2, v) = mi{e > : /i(E) < iy{E,) +e, E Borel in 5"-^}; 
see dZl. 

We need a condition on a sequence (««) in S^~^ stronger than denseness in S*""^. To this 
end, for u G S""-^ and < t < 2, let 

be the open spherical cap with center u and radius t. We call (wj) evenly spread if for all 

< t < 2, there is a constant c = c{t) > and an = N{t) such that 

...,Uk}n Ctiu)\ > ck, 
for all u G 5*""^ and k > N. Often, we will apply this notion to the symmetrization 

(U*) = (mi, -Ml, M2, -M2, ^^3, -U3, ■ ■ •) 

of a sequence (uj). 

Let p > 1. A family {X^ : a G A} of random variables has uniformly bounded pth absolute 
moments if there is a constant C such that 

(15) E{\X^\n<C, 

for all a G A. Of course, if p is an even integer, we can and will omit the word "absolute." If 

1 < q < p and (15) holds, then it also holds with p replaced by q and C replaced by C^^. 
Triangular arrays of random variables of the form {Xj^ : i = 1, . . . ,mk; k G N} (or, more 

generally, {Xak '■ « ^ A^; k G N}) are called row-wise independent if for each k, the family 
{Xik : i = I, . . . , nik} (or {X^k '■ « £ ^k}, respectively) is independent. 
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4. The main algorithm for reconstruction from covariograms 

We shall assume throughout that the unknown convex body Kq is contained in the cube 
Co = [—1/2, 1/2]", with its centroid at the origin. This assumption can be justified on both 
purely theoretical and purely practical grounds. If the measurements are exact, then from the 
covariogram, a convex polytope can be constructed that contains a translate of Kq. On the 
other hand, in practise, an unknown object whose covariogram is to be measured is contained 
in some known bounded region. In either case, one may as well suppose that Kq is contained in 
Cq, and since in the situations we consider, the covariogram determines Kq up to translation 
and reflection in the origin, we can also fix the centroid at the origin. 

We now state the main, second-stage algorithm. Note that it requires, as part of the in- 
put, an o-symmetric convex polytope that approximates either the Blaschke body VKq or the 
difference body DKq of Kq. These are provided by the first-stage algorithms. Algorithm Noisy- 
CovBlaschke and Algorithm NoisyCovDiff (</)), described in Sections |5] and [6| respectively. 

The reader should be aware that here, and throughout the paper, double subscripts in 
expressions such as Xik, Mik, Nn^., etc., represent triangular arrays. Thus, for a fixed k, the 
index i varies over a finite set of integers that depends on k; and similarly when the first index 
is labeled by another letter in expressions such as Zjk, Xp^, and so on, or is itself represented 
by a double index, as in Nijk. Phrases such as "the Ni^s are row- wise independent" mean 
that the corresponding triangular array is row-wise independent, i.e., independent for fixed k. 

Algorithm NoisyCovLSQ 

Input: Natural numbers n > 2 and k; noisy covariogram measurements 

(16) = QKoixik) + iVifc, 

of an unknown convex body Kq C Cq whose centroid is at the origin, at the points Xj^, 
i = 1, . . . = {2k + 1)" in the cubic array 2Cq fl (l/fc)Z", where the Ni^s are row-wise 
independent zero mean random variables with uniformly bounded third absolute moments; 
an o-symmetric convex polytope Qk in M", stochastically independent of the measurements 
Mik, that approximates either VKq or DKq, in the sense that, almost surely, 

(17) lim 5(Qfc, ViTo) = 0, or Mm 5{Qk, DKq) = 0. 

Task: Construct a convex polytope Pk that approximates Kq, up to refiection in the origin. 
Action: 

1. Compute the outer unit normals {±Uj : j = 1, . . . , s} to the facets of Qk- 

2. For any vector a = {a^ , ■ ■ ■ ,af ,aj), where <ij,CL] > 0, j = l,...,s, such 
that Yl]=ii.'^^ ~ (^j)'^j = ^5 l^t P{a) = P{a^, , a^, 03 , • • • , a^, aj) be the convex polytope 
with centroid at the origin, facet outer unit normals in {±Mj '■ j = 1, . . . ,s} and such that 
the facet with normal Uj (or —Uj) has (n — l)-dimensional measure (or aj , respectively), 
j = l,...,s. 

Solve the following least squares problem: 
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h 

(18) mill ^ {Mik - gp(a)ncsi^ik)) 

i=l 

over the variables a'l , a|f, a^, , . . . , af, a~ , subject to the constraints 

s 

^(a+ - a-)uj = o 
i=i 

and 

a^,aj > 0, J = 1,. . . ,s. 

These constraints guarantee that the output will correspond to a convex polytope. 

3. Let a set of optimal values be af ,ai ,0^2 ,0,2 , ■ ■ ■ ,aj , and call the corresponding 
polytope P{a). Then the output polytope Pk is the translate of -P(a) fl Cq that has its 
centroid at the origin. Note that in this case —Pk also corresponds to a set of optimal values 
obtained by switching and aj , j = 1, . . . , s. 



Lemma 4.1. Let < r < R and let Q G )C"'{r,R) be an o-symmetric convex polytope. Then 
there are facets of Q with outer unit normals ui, . . . ,Un such that 

(19) |det(Mi,...,wOI>(^/^)"^""'^/'- 

Proof. The polar body Q* of Q is contained in /C"(l/i?, 1/r) and has its vertices in the 
directions of the outer unit normals to the facets of Q, so it suffices to prove that there 
are vertices Wi, . . . , f„ of such that with Ui = Vi/\vi\, (19) holds. 

The proof will be by induction on n. Let n = 2. We may assume that Q* has a vertex, 
Vi say, on the positive X2-axis. Since Q* G /C^(l/-R, 1/r), there must be another vertex t>2 of 
Q* with distance at least 1/R from the X2-axis, and by the symmetry of Q*, such that also 
V2 ■ 62 > 0. If a is the angle between vi and V2, we must then have < a < tt/2, where 6 is 

the angle between the vectors (0, 1/r) and (^l/R, a/ (1/t^) — (1/-R^) j . Then, if Ui = Vi/\vi\ for 

i = 1,2, we have 

I det(Mi, ^2)1 = sin a > sin 6* = r/R, 

which proves (19) for n = 2. 

Suppose that (19) holds with n replaced by n — 1 and let Q* G /C"(l/-R, 1/r). We may 
assume that Q* has a vertex, vi say, on the positive x„-axis, so that fi/|fi| = e^. Since 
Q*\e^ G /C"'~^(l/i?, 1/r) (where we are identifying e:^ with M""-^), by the inductive hypothesis, 
there are vertices W2, . . . , w„ of Q*|e^ such that if Zi = Wi/\wi\, i = 2, . . . ,n, then 

(20) |det(^2,...,^n)|>(r/i?)("-^)(""^)/^. 

Let Vi be a vertex of Q* such that Vi\e^ = Wi, i = 2, . . . ,n, and let = Vi/\vi\, i = 1, . . . ,n. By 
the symmetry of Q*, we may also assume that f j ■ > for i = 2, . . . ,n. Let be the angle 
between Vi and Wi, ior i = 2, . . . ,n. Using the fact that Q*\e^ G /C"~^(l/i?, 1/r), we see that 
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each Vi, i = 2, . . . ,n has distance at least from the x„-axis. Therefore cos > sin^ = r/R 
for z = 2, . . . ,n. Then, using (20) and noting that ui = Cn and Ui = Ui\e^ + {ui ■ en)en for 
i = 2 n, we obtain 



det(Mi, ...,Un) 



= |det(M2|e^,...,Mn|e;[)| 

n 

= \det{z2,...,Zn)\Y\_cosai 

i=2 



□ 



Lemma 4.2. Let K G /C"(r, R), letO < e < K„_ir" ^/2, and let L be a convex body containing 
the origin in such that 



(21) 



dpiSiK,-),S{L,-))<e. 



Then there is a constant ai depending only on e, r, and R such that L C Oi-B". If L is o- 
symmetric, there is also a constant qq > depending only on e, r, and R such that a^B'^ C L. 

Proof. Using Q and ([s]), we obtain 

(22) \hnK{u) - hnL{u)\ = \hK{u) - 6^(^)1 < dD{S{K, ■), S{L, ■)). 

Here do is the Dudley metric, defined by 

^^(/i, z/) = sup <^ / / d{^ - u) 
where for any real- valued function / on S^~^ we define 



< 1 



L = sup 

^n— 1 



and 



\u — v\ 



BL 



+ 



(Note that for any u G S'^ , the function f{v) = \u ■ v\/2, v G satisfies 
[T71 Corollary 2], we have the relation 

(23) doifi,!^) <2dp{fi,u), 



BL 



1.) By 



for finite nonnegative Borel measures /i and i/ in 5" . Now (22), (23), and (21) yield 

\hnK{u)-huL{u)\<2dp{S{K,-),S{Lr))<2e, 

for each u G 5*"^^ 

Since K G lC{r,R), we have UK G /C" (K„_ir"-\ K^.ii?'^"!), so liL G /C"(fi:„_ir"-i - 
2e, Kn-iR"'~^ + 2e). Now exactly the same argument as in the proof of Lemma 4.2 of [25] , 
beginning with formula (16) in that paper, yields the existence of oi and oq. (The assumption 
of o-symmetry made in [25] is only needed for the latter. Explicit values for oq and ai can be 
given in terms of e, r, and R, but we do not need them here.) □ 



PHASE RETRIEVAL FOR CHARACTERISTIC FUNCTIONS OF CONVEX BODIES 15 

Lemma 4.3. Let K be a convex body in M". Then there is an Eq > such that for all 
< e < Eq, if Q is an a -symmetric convex polytope in M" such that either 

(24) dp{S{VK,-),S{Q,-))<e 
or 

(25) dp{S{DKr),S{Q,-))<e, 

then there is a constant ci > depending only on K and a convex polytope J whose facets 
are each parallel to some facet of Q, such that 

(26) dp{S(K,-),S{Jr))<(m. 



Proof. We choose > so that Lemma |4.2| holds when e is replaced by Eq and K is replaced 
by either V K or DK, as appropriate. Let < e < eo- 

Let ±ui, . . . , be the outer unit normals to the facets of Q and for z = s + 1, . . . , 2s, let 
Ui = -Ui-s- Set / = {1, . . . , 2s}. 

Suppose that (|24|) holds. By (|T3|), S{VK,E) < S{Q,Es) + e for each Borel subset E of 
If E, n Uie/{Mi} = 0, we have S{Q,Es) = 0. This implies that S{VK,E) < e and so 

by©, 

(27) S{K, E) < 2e. 

If instead (25) holds, then (13) implies that S{DK,E) < S{Q,Ei;) + e for each Borel subset 
E of ^"-^ Then, if E^ n Uiei{ui} = 0, we have S{DK,E) < e. By [46, (5.L17), p. 275], 

S{DK,E) = S{K +{-K),E) = S{K,E) + ■ ) S{K,n - 1 - j; -K,j, E), 

j=i V ^ / 

where S{K, n — 1 — j; —K,j, ■) denotes the mixed area measure of n — 1 — j copies of K and 
j copies of —K. Since all these terms are nonnegative, we obtain S{K,E) < e and so (27) 
holds again. 
For i & I, let 

Vi = {u G S''^~'^ : \u — Ui\ < \u — Uj\ for each j G I, j ^ i} 

be the Voronoi cell in S*""^ containing Uj. Choose Borel sets Wi such that relint Vi G Wi G Vi 
for each i and Wi (iWj = (!) for i ^ j, so that {Wi : i G 1} forms a partition of S"'~^. 
Let = S{K, Wi) and let w = Yli^^i '^i'^i- Since S{K, ■) is balanced, i.e.. 



u dS{K, u) = o, 



we have 



y^ttiUi = y^Ui / dS{K,u) — / udS{K,u) 
y I {ui — u) dS{K,u). 



W = 
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For each u G S"-^ and t > 0, let Ct{u) = {v e S''-^ ■.\u-v\< t}. Let W = Uiei{Wi\Cs{ui)). 
Then Ui ^ We for i G /, so (27) imphes that S{K, W) < 2e. Using this, we obtain 



\w\ 



(28) 



y / {ui — u) dS{K, u) + 2^ / (^j ~ dS{K, u) 

.^j Jw,nc,{u,) -^j Jw,\Cs{u,) 

< V/ \u,-u\dS{K,u) +2 I dS{K,u) 

< eS{K, S""-^) +Ae = {S{K) + A)e. 



Since Q is o-symmetric, we can apply Lemma 4.2 (with K and L replaced by WK (or 



DK) and Q, respectively) and Lemma 4.1 to conclude that there exist outer unit normals 



Mjj, . . . , Ui„ to facets of Q such that | det(-Uj^, . . . , Mi„)| > C2, where qg] depends only on K. In 
particular, Wj^, . . . , Ui^ forms a basis for M", so there exist real numbers . . . , bi^ such that 



j=i 

Replacing Uj^- by —Ui. , if necessary, we may assume that bi^ > for j = 1 
rule, we obtain bi. < \w\/\ det(Mij, . . . ,Mj„)| < |w|/q2], for j = 1 
i & I such that i ^ {ii, . . . Then, by (28), 



, n. By Cramer's 
n. Define 6,- = for each 



(29) 



< n\w\/c^< cge. 



where qj] depends only on K. 
Let 

/xo = ^ ai6ui and /Ui = ^ kS^i, 
and let /i = yUo + /^i- Then the support of /i is not contained in a great sphere, and since 



/ u dfi{u) = y ^{aj + b, 



)Ui = w — w = o, 



IX is balanced. By Minkowski's existence theorem [21^, Theorem A. 3. 2], there is a convex 
polytope J such that S'( J, ■) = /i. By its definition, each facet of J is parallel to a facet of Q. 
It remains to prove (26). Using (29), we obtain 



dp{S{J,-),S{K,-)) = dp{^o + fJ'i,S{K,-)) <dp{fio + fJ'i,fJ'o) + dp{fio,S{K,-)) 
= rfp(/ii,0) + dp{iJ,o,S{K,-)) < + dp{iJo,S{K,-)), 

where is the zero measure in S*"^^. In view of /io(5'"^^) = S{K, S"'^^) and (14), it is therefore 
enough to find a constant C4, depending only on K, such that 

(30) fXo{E)<S{K,E^) + q^, 
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for any Borel set E in Let X = U{Wi : e ^} \ E^. We have 

SiK,E,) > SiK,E,niU{Wi:UieE})) 
(31) = J2^S{K,W,):u,eE}-S{K,X) = fio{E)-S{K,X). 

If X G X, then for some i with Ui & E we have x G Wi, and so \x — Ui\ > e since x ^ 



Moreover, if j 7^ then [mj — x\ > \ui — x\ > e. Hence Uig/j-Uj} fl X^ 
have S{K, X) < 2e. Now imphes that Q holds with eg] = 2. 

For a fixed finite set zi, . . . ,Zq of points in M", define a pseudonorm 



and by (27), we 
□ 



by 



(32) 



1/2 



where / is any real- valued function on MJ^. For a convex body K contained in Cq, vector 
Zg = {zi, . . . ,Zq) of the points zi, . . . , Zg in M", and vector Xg = (Xi, . . . , Xg) of random 



variables Xi, . . . , Xg, let 



(33) 



I 1 

^iK,Zg,Xg) = -J29Kiz^)Xi 



i=l 



Lemma 4.4. Let A; G N and let Kq C Cq be a convex body with its centroid at the origin. 
Suppose that Pk is an output from Algorithm NoisyCovLSQ as stated above. Let P{a) be any 
convex polytope admissible for the minimization problem (IS). Then 

(34) Iqk, - gpJl < 2vl>(P,,x,,,N,J - 2^{P{a) n C^,^j^,Nj^) + \gK, - 9Pia)ncs\l , 



where for each A; G N, | ■ 1/^ and \l/(-ft', x/^., N/^.) are defined by (32) and (33), respectively, with 
q = Ik, = (xifc, . . . , xi^k), and N4 = (Nik, X/^fc). 

Proof. If P{d) n Cq is a solution of (18), then since gp,, = gp{a)nc^^ we obtain 

Ik Ik 

^ (Mifc - gp^{x^k))'^ < ^ (Mifc - gp(a)ncsixik)) , 



i=l 



1=1 



Substituting for Mj^ from (16) and rearranging, we obtain 

Ik Ik Ik 

^ (gKoi^ik) - 9Pk{xik)f < 2 gp^{xik)Nik - 2 gp{a)nc^{xik)Nik + 

i=l 1=1 i=l 

Ik 

i=l 



In view of (32) and (33), this is the required inequality. 



□ 
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Let K be any convex body in M" and let £ > 0. The inner parallel body K 55" is the 
Minkowski difference of K and eB^ as defined in ([2]). Then 

KeeB^^= fl {K-y), 

y£eB" 

SO the inner parallel body is convex. (It may be empty.) For further properties, see |l6l 
pp. 133-137]. The following proposition is an immediate consequence of the fact that if K is 
a convex body in MJ^, then 

(35) V{K) -V{K eeB'') < S{K)e. 

This follows directly from either an inequality of Sang wine- Yager or one of Brannen; see The- 



orem 1 or Corollary 2 of [13], respectively. The estimate (35) both generalizes and strengthens 
\23\ Lemma 4.2], which concerns the case n = 2. The authors of the latter paper were unaware 
that an even stronger estimate for n = 2 was found earlier by Matheron j39] . 

Proposition 4.5. If K G Cq is a convex body and e > 0, then 

V{K) - V{K e e5") < 2ne. 

Let Q be the class of all nonnegative functions g on M" with support in 2Cq that are the 
covariogram of some convex body contained in Cq, together with the function on M" that is 
identically zero. Note that for each g E Q and x G M", g{x) < gc^{x) < V{Cq) = 1. 

Lemma 4.6. Let < e < 1 be given. Then there is a finite set {{gj,gf) '■ j = 1, . . . ,m} of 
pairs of functions in Q such that 

(i) \\g^ -gf\\i<eforj = l,...,m and 

(ii) for each g E Q , there is an j E {1, . . . , m} such that gj<g<gf- 

Proof. Let < £ < 1 and let C5 = c^^n) > 1 be a constant, to be chosen later. Since /C'^(Cq) 
with the Hausdorff metric is compact, there is an e/(^iaet {Ki, . . . , Km} in /C"'(Cq ). For each 
j = 1, . . . , m, let Kf = {Kj + (e/qsl)^") n Q and Kf = Kj Q {e/q^B''. Define g^ = gKU and 

9j = fl'A'^) j = 1; • • • ? ""^^ Both gj^ and gj" belong to ^, j = 1, . . . , m. 

We first prove (ii). Let g E Q. There is a G IC^iC^) such that g = g^- Choose 
j G {1, . . . , m} such that 6{K, Kj) < e/qg. Since K C Cq and K C Kj + [e/q^B"^, we have 
K C {Kj + (e/q5i)5") n Q = Kf. Also, we have 



(K, e (e/q^B^) + (e/q^B^ C K^ C K + (e/c^B 



n 

5 



yielding Kj' = Kj {e/q^B" C K. These facts imply that g^ < g < gf , as required. 

It remains to prove (i). It is easy to prove (see, for example, [Ml p. 411]) that for any 
convex body L in M", 

I gL{x)dx = V{Lf. 
Jdl 
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Applying this, Steiner's formula with quermassintegrals (see |20l (A. 30), p. 404], basic prop- 
erties of mixed volumes (see [20| (A. 1 6) a nd (A. 18), p. 399]) together with Kj C Cg C 
(n/4)^/^i?" and q5]> 1, and Proposition 4.5 with e replaced by e/qg, we obtain 




g'^-g'^h = l {gf{x)-gfix))dx = V{Kfy-V{KfY<2{V{K!/)-V{K})) 
< 2{{V{K, + ^B-) - V{K,)^ + (V{K,) - V (^K, Q ^B" 



n 



n\ {n-i)/2 




< 2 U„ > ( ^ J ) + 2n I ( - 1 < £, 

provided that qs] is chosen sufficiently large. □ 
By analogy with [IHl Definition 2.2], we refer to a finite set {{g^^g^) '■ j = 1, . . . ,m} of 



pairs of functions in Q satisfying (i) and (ii) of Lemma 4.6 as an e-net with bracketing for the 
class Q. 

The following proposition is a version of the strong law of large numbers that applies 
to a triangular family, rather than a sequence, of random variables. A version with the 
assumptions of full independence and uniformly bounded fourth moments is proved in detail 
in |23l Lemma 4.4], with = k. The stronger statement below follows directly from [SUl 
Corollary 1] (with p = 1 and n = rrik there); in fact, it is enough to assume the uniform 
boundedness of pth absolute moments where p = 2 + e for some e > 0, but we prefer to avoid 
this extra parameter in the sequel. 

Proposition 4.7. Let Xik, k & N, i = l,...,mk, where ruk > k, be a triangular array of 
row-wise independent zero mean random variables. If the array has uniformly bounded third 
absolute moments, then, almost surely, 

(36) — Vx,fc^O 

1=1 

as —)■ oo. 

Lemma 4.8. For every G N, let Xik, i = 1, . . . , Ik, be the points in the cubic array 2Cq H 
(l//c)Z". Let Nik, k E N, i = 1, . . . , Ik, be row-wise independent zero mean random variables 
with uniformly bounded third absolute moments. Then, almost surely, 

sup ^'(if,X4,N4) 



as k ^ oo, where for each A; G N, \E'(_ft', x/^., N^) is defined by (33) with q = Ik, x/^. = 
{xik, ■ ■ ■,xi^k), and N/^ = (A^i^, . . .,Ni^k)- 

Proof. Let < £ < 1 and let {{g^^g^) : j = 1, . . . ,m} be an e-net with bracketing for as 



provided by Lemma 4.6 Let K G /C"(Cq) and let g = gx ^ G- Choose j G {1, . . . ,m} such 
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that g} <g < gf . Define A^J; = max{Nik, 0} and iV^ = iV - Nik for A; e N and i = 1, . . . , h- 
Then for /c G N, we have 



ik 

< W,(e) 



where 



is independent of K. Consequently, 

(38) sup <f{K,^j^,NjJ<Wk{e) 

for all < £ < 1. 

Fix j G {1, . . . , m}, and let 



Xik = gf{x,k)N^k-9''{xik)E 



ik)i 



for /c G N and i = 1, . . . , Jfc. Since g^{xik) < 1, it is easy to check that the random variables 



Xik satisfy the hypotheses of Proposition 4.7 By (36) with rrik = Ik, we obtain, almost surely 



limsup ^ ^^7(a;ifc)Ar+ = limsup — '^gf{xik)E{N^^). 



i=l i=l 



The same argument, with limits superior replaced by limits inferior, applies when Xj^ is defined 
by = 9j{^ik)X,^ — gj{xik)E{N^). Our moment assumption on the random variables Ni^ 
implies that there is a constant C such that 



E{Nt,) = EiN-) = ^Em,\)<C. 
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Also, by Lemma 4.6 i) we have Wg^ — g^\\i < s and by Lemma 4.6|^ii) we may assume that 



— (^j" > 0, for z = 1, . . . , m. Therefore, almost surely. 



lim Wk{e) 

fc— ^oo 



max 

j=l,...,m I If. 



lim sup - ^ (77(x,fc)E(iV+) - hminf Y,9-{x,k)E{N^ 

fc->oo J-k ■ -I /c-s>oo If. 

1=1 1=1 

< max < C lim sup — > 9^ {xik) — liminf — N g^{x 

j=l,...,m \ j,^^ Jfc ^ fc-^oo Jfc ^ 

\ 1=1 1=1 




{gf{x)-gf{x)) dx\< 



Ce 



This and (38) complete the proof. 



□ 



Lemma 4.9. Let Kq C Cq he a convex body with its centroid at the origin. Suppose that Pk 
is an output from Algorithm NoisyCovLSQ as stated above. Then, almost surely, 



(39) 



lim 



k l/j. 



0. 



Proof. Let Qk be the o-symmetric polytope from the input of Algorithm NoisyCovLSQ that 



satisfies, almost surely, (17). Fix a realization for which (17) holds. We may assume that 



lim 6{Qk,VKo)=0, 



as the other case is completely analogous. By |l6l Theorem 4.2.1], S{Qk, ■) converges weakly 
to SeVKo, ■) as — oo. By [TOl Theorem 6.8], weak convergence is equivalent to convergence 
in the Prohorov metric, so S{Qk, ■) converges in the Prohorov metric to S{VKo, ■) as /c — )■ oo. 
Now Lemma [43 ensures that if Jk is the convex polytope corresponding to Qk in that lemma, 
then S{Jk, ■) converges in the Prohorov metric to S{Ko, ■) as A; — )■ oo. We may assume that 



the centroid of Jk is at the origin for each k. By Lemma 4.2 (with K and L replaced by 
Kq and Jk, respectively), there are constants ai and G N, depending only on Kq, such 
that Jk C aiB^ for all k > k^. By Blaschke's selection theorem and the fact that a convex 
body is determined up to translation by its surface area measure, the sequence (J^) has an 
accumulation point and every such accumulation point must be a translate of Kq. But Jk and 
Ko have their centroids at the origin and Kq C Cq , so 

lim 6iKo, Jk n Q) = lim 6{Ko, Jk) = 0. 

fc— >oo fe— >oo 

(This consequence of the fact that dp{S{Jk, ■), S{Kq, ■)) — )■ as — )■ oo can also be derived 
from a stability estimate of Hug and Schneider [311 Theorem 3.1], but we do not need the full 
force of that result here.) It follows from the continuity of volume that \\gKo ~ 9Jknc^\\oo ^ 
as A; — )■ oo and hence that 



(40) 



lim IgKo -gh 



nc; 



I/,. 



0. 
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Next, we observe that Jk can serve as the P{a) in Lemma 4.4 By its definition, a translate 
of Pk is contained in Cq, and the quantity \l/(Pfc, x^, N^) is unaffected by this translation. 
From Lemma 14.81 we obtain 



(41) 



lim ^(Pfc,x,,,N,, 



and lim ^{Jk H Cq", xj,, N.J = 0. 



fc— ^oo 



Now (39) follows directly from (34) (with P{a) replaced by J^), (40), and (41) 



□ 



Theorem 4.10. Suppose that Kq C Cq is a convex body with its centroid at the origin. Sup- 
pose also that Kq is determined, up to translation and reflection in the origin, among all convex 
bodies in M", by its covariogram. If Pk, k ^N, is an output from Algorithm NoisyCovLSQ as 
stated above, then, almost surely, 

(42) mm{S{Ko, Pk), S{-Ko, Pk)} ^ 

as A; — 7- oo. 



Proof. By Lemma 4^, almost surely, 

(43) \9ko- gPkli^^O, 

as A; — 7- oo. Fix a realization for which this statement holds. For each k, Pk has its centroid 
at the origin and is a translate of a subset of Cq, so Pk C 2Cq and by Blaschke's selection 
theorem, {Pk) has an accumulation point, L, say. Note that L must also have its centroid at 
the origin and be a translate of a subset of Cq. 

Let {Pk') be a subsequence converging to L. Then since qkq — QPy converges uniformly to 
9kq — Ql as k' — )■ cxD, we have 

,2 1 



{gKo{x) - gL{x)) dx, 



as k' — 7- oo. From this and (43), we obtain \\gKo ~ 9 l\\ 1^(^20^) ~ hence, since covari- 

ograms are clearly continuous, gxo = 9l on 2Cq. As the supports of gxo and gL are contained 
in 26*0 , we have gxo = gi in I^"- The hypothesis on Kq now implies that L = ±Ko. Since L 
was an arbitrary accumulation point of {Pk), we obtain (42). □ 



5. Approximating the Blaschke body via the covariogram 



Algorithm NoisyCovBlaschke 

Input: Natural numbers n > 2 and k; mutually nonparallel vectors Mj G S"^^, i = 1, . . . ,k 
that span M"; noisy covariogram measurements 

MSl = gKM + N^jl and = (?^„((1 AK) + ^^5^' 

for i = 1, . . . ,k and j = 1, . . . , /c^, of an unknown convex body Kq C Cq whose centroid is 
at the origin, where the N^^^?> are row- wise independent (i.e., independent for fixed k) zero 
mean random variables with uniformly bounded sixth moments. 
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Task: Construct an o-symmetric convex polytope Qk that approximates the Blaschke body 
Action: 

1. For i = 1, . . . , and j = 1, . . . , fc^, let 

2. With the natural numbers n > 2 and /c, and vectors Ui G S*"^^, i = 1,. . . ,k use the 
sample means yik instead of noisy measurements of the brightness function hxiui) as input to 
Algorithm NoisyBrightLSQ (see [211 p. 1352]). The output of the latter algorithm is Qk- 



For a fixed finite set Ui, . . . ,Ug of points in 5" ^, define a pseudonorm | • |q by 

1/2 



(44) I/I 



where / is any real- valued function on S*" ^. For a convex body K contained in Cq, a sequence 
(ui) in 5""""^ and a vector = (Xi^, . . . ,Xkk) of random variables, let 

k 

^{K, {u,),Xk) = ^J2^K{u,)Xik. 

i=l 

The same notations were used for a technically different pseudonorm and function \1/ in the 
previous section, but this should cause no confusion. 

Lemma 5.1. Let Kq be a convex body in M" with centroid at the origin and such that 
rB"- C Kq C Cq for some r > 0. Let {ui) be a sequence in S"'~^. If Qk is an output 
from Algorithm Noisy CovBlaschke as stated above, then, almost surely, there is a constant 
Cq = CQ{n,r) such that 

(45) \bK, - bQ,\l < 2^{Qk, {u,),Xk) - 2vl/(Ko, {u^),Xk) + ^\bK, - fegj^, 

for all A; G N. Here Xjt = (Xi^, . . . , Xkk), with 

for i = 1, . . . , k. 

Proof. For i = 1, . . . , A;, we have 



Vik 



k'2 

9ko{o) - gKa{{l/k)ui) 



Ilk k . ^ 

I j=i 
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where the Xj^'s are row-wise independent zero mean random variables. Note that the Uik^ 
are also row-wise independent. Furthermore, by Khinchine's inequality (see, for example, p9| 
(4.32.1), p. 307] with a = 6), there is a constant C such that 



from which we see that the Xj^'s also have uniformly bounded sixth moments. By Lemma 3.1 



lim fiik = bKoiui)- 

k—^co 

In fact, the convergence is uniform. This is because for each u G S"'~^, we have 
and 

1 \ n—l\ 



(46) < bK,{u) -^i^k<\l-{l-^] bK,{u) < -^K>{u), k > l/(2r). 



by Lemma 3.1, so there is a constant cy = Cjin^r) such that 

(47) < 6xo(Mi) -/Uifc < p 

for all /c G N and i = 1, . . . , k. 

By the formulation of Algorithms NoisyCovBlaschke and NoisyBrightLSQ (see |2ll p. 1352] 
and take |2H Proposition 2.1] into account), Qk minimizes 

k 

(48) J](&i^(w.)-l/ifc)' 

i=l 

over the class of all o-symmetric convex bodies K in M". By ([t]), for each convex body there 
is an o-symmetric convex body with the same brightness function. From this it follows that 
Qk is actually a minimizer over the class of all convex bodies in M". Substituting K = Qk 
and K = Kq in ( [48| ), we obtain 

k k 

{bQk{ui) - fiik - Xikf < ^ {bKo{ui) - fiik - Xikf . 

1=1 i=l 

Rearranging and using ( [44| ), we obtain 

2 ^ 

\bKo -bQfk<-j^Yl ~ ^Koiui)) {Xik - (bKoiui) - liik)). 

i=l 

The definition of \E' and Cauchy-Schwarz inequality yields 

/ k XV2 

\bK,-bQ^\l < 2^{Qk,iu,),Xk)-2^{Ko,{ui),Xk) + 2\bKo-bQjk ^J2^bKo{ui) - fiikY 
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In view of (47), this proves (45) with 



2qz]. 
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Lemma 5.2. Suppose that the assumptions of Lemma 5.1 are satisfied with a sequence (ui) 
such that (u*) is evenly spread. Suppose also that the second moments of the Xik's are 
uniformly bounded by a constant C > 0. Then, almost surely, there are constants Cg = 
Cs{C,n,r, (ui)) and Ni = Ni{{Xik), (uj)) such that 

(49) S{Qk) < m 

for all k > A^. 

Proof. By the Cauchy-Schwarz inequahty, 




This and ( 45 ) imply that 



\bKo - k 



< 2 




for all /c G N. Since the Xj^'s have uniformly bounded sixth moments, we can apply Propo- 
sition 4.7 with m/c and Xik replaced by k and Xfi^ — E{Xfi^), respectively, to conclude that 
the first term on the right-hand side is bounded, almost surely. Thus, almost surely, there are 
constants Cg = CQ{C,n,r) and = N2{{Xik), {ui}) such that 



(50) 



for all k > As [u*) is evenly spread, we can apply f2M Lemma 7.1] with K and L replaced 
by UKo and UQk, respectively. Using this, the fact that UKq C UCq = 2Cq C ^/nB'^ (see 
[20t p. 145]), and ([i]), we find that there are constants cio = cio(('Ui)) and A's = N^{{ui)) 
such that 



(51) 



□ 



for A; > A^ Finally, (|49|) follows directly from (|50|), (|5T|, and (|6|. 

Lemma 5.3. Suppose that the assumptions of Lemma 5.1 are satisfied with a sequence {ui 
such that {u*) is evenly spread. Then, almost surely. 



(52) 



lim \bKo - be 



0. 



Proof. Choose a constant Ci such that E {\Xik\ ) < Ci for all i and k. Due to (45) and (50), 
there is, almost surely, a constant cn = cii{Ci,n,r) such that 



(53) 



bKoll < 2^{Qk, iui),Xk) - 2^(iro, (M.),Xfe) + 



k ' 



for all k > A^ By Proposition 4.7 with = k and Xj^ replaced by bKo{ui)Xik, the variable 
"^{Kq, (Mj),Xfc) converges to zero, almost surely, as A; — )■ oo. 
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For m G N, let Tim = {K G JC"' : S{K) < m}. If we can show that for all m E N, almost 
surely, 



(54) 



then by (49), almost surely. 



lim sup |^(ir, (Mi),Xfc)| = 0, 



lim ^(Qfc, (ui),Xfc) = 0. 

k—^oo 



This and ( 53 ) will yield ( 52 ) , completing the proof. 
To prove (54), note first that by ([s]), we have 

k 

|*(ir,(u,),Xfc 



1 . % If 1 X % 

i=l J S"-"^ j^^i 



dS{K,v). 



Since S{K) = S{K, S*" ) < m for K G Tim, it is enough to prove that, almost surely, 

1 

- ^ |Mi ■ v\Xik 



(55) 



lim sup 



1=1 



0. 



This follows essentially from the uniform continuity of the function \ui ■ v\, v E S*""^, and the 
fact that S""^ is compact. Indeed, suppose that (55) does not hold almost surely. Choose a 
constant C2 such that E{\Xik\) < C2 for all i and k. Then there is a 5 > such that 



(56) 



1 ^ 

lim sup sup - \ui ■ v\Xik > 6C2 



with positive probability. Let {wi, . . . , Wm} be a 5/2- net in S*" ^. For any realization and any 
/c G N, there is a f ^ G 5*"^^ such that 

(57) \^^\ui ■ Vk\Xik = sup j-y^Mi- v\Xik. 



i=l 



1=1 



Let Aj denote the set of all events such that an accumulation point of {vk) has distance at 
most 5/2 from Wj, j = 1, . . . , m. For a realization in Aj and any subsequence {k') of {k) such 
that — < 5 holds for sufficiently large /c, we have, almost surely, 

— ^ |ui ■ ffc'lXifc/ - Tj l^^i ■ w^jl-'^ifc' < 5 lim sup — ^ < 



lim sup 

fc'— >oo 

by Proposition 

Proposition 4.7, with and Xj^ replaced by k' and l^j • Wj\Xiki, respectively, also implies 
that, almost surely, the second term on the left-hand side converges to zero, as k' — t- 00. In 
view of (57), this yields 



i=l i=l i=l 

4.7| with m/c and Xik replaced by k' and \Xik' \ — E{\Xik'\), respectively. But 



1 

lim sup sup —y \ui- v\Xiki < 5C2, 

-"n-l k' ^-^ 



k'^00 v&S' 



i=l 
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for almost all events in Aj. As any sequence in S^~^ has at least one accumulation point, the 
latter inequality holds, almost surely, contradicting (56). □ 

Theorem 5.4. Let Kq C Cq he a convex body with its centroid at the origin. Let (ui) be a 
sequence in S""^^ such that (u*) is evenly spread. If Qk is an output from Algorithm Noisy- 
CovBlaschke as stated above, then, almost surely, 

(58) Urn 6{VKo,Qk) =0. 



Proof. We have a G int Kq, so there is an r > such that ri?" C Kq. By Lemmas 5.2 and 5.3 



we can fix a realization for which both (49) and (52) are true. Using (|4]), we observe that (52) 
is equivalent to 

(59) lim \huKo - huQ^lk = 0. 



We also have hnq^. = < S{Qk), so by (49), the sets IlQk are uniformly bounded. With 
these observations and the fact that {ui, —ui, U2, —U2, . . . ) is evenly spread, we can follow the 
proof of [Ml Theorem 6.1]), from the fourth line, with K and Pk replaced by Ili^o and HQk, 
respectively, to conclude that 

(60) lim 5{UKo, UQk) = 0. 

k—^oo 

Now rB'"- <Z Kq <Z Cq yields si?" C UKq C t-B" with s = K„_ir""^ and t = ^Jn. Moreover, 
(|4|) and (g give K^) = UKq. Hence (Q implies that 

for sufficiently large k, where s and t depend only on n and r. Exactly as in the proof from 
(48) to (49) of f2M Theorem 7.2] (which in turn follows the proof of Lemma 4.2]), this 
leads to 

ro5"C VKo,QfcCi?o5", 

for sufficiently large k, where ro > and Ro depend only on n and r. Then (58) follows from 

(60) and the Bourgain-Campi-Lindenstrauss stability result for projection bodies (see [H] and 
[IS], or [201 Remark 4.3.13]). □ 

6. Approximating the difference body via the covariogram 

Throughout this section, ip will be a nonnegative bounded measurable function on M" with 
support in Cq, such that ip{x) dx = 1. 

Algorithm NoisyCovDiff((yi?) 

Input: Natural numbers n > 2 and k] positive reals 6k and e^; noisy covariogram measure- 
ments 

(61) Mik = QKoiXik) + A'ife, 
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of an unknown convex body Kq C Cq at the points Xik, i = 1, . . . ,/fc in the cubic array 
2Cg n (1/A;)Z", where the Ni^s are row-wise independent zero mean random variables with 
uniformly bounded fourth moments. 

Task: Construct an o-symmetric convex polytope Qfc in that approximates the difference 
body DKq. 

Action: 

1. Let (pe^ix) = e^"(p{x/ek) for x G W\ and let 



(62) gkix) 



Ik I, /Ik \ 

I {x-z)dz= V Mik l(i/k)cs+x..k * "Psk (x)- 

Jil/k)CS+x,k Vi=i / 



2. Define the finite set 
(63) Sk = {xe 2Co" n (1/A;)Z" : gk{x) > 4}- 

The output is the convex polytope Qk = (l/2)(conv + (— convS'fe)). 

The input 6k in the algorithm is a threshold parameter. The function gk{x) is a Gasser- 
Miiller type kernel estimator for g^o with kernel function (p and bandwidth Sk- As the design 
points Xik are deterministic, g^ is a multivariate fixed design kernel estimator. Such estimators 
are common in multivariate regression and are discussed in detail by Ahmad and Lin [3]. 
Among other things, strong pointwise consistency and a bound for the rate of weak pointwise 
convergence are given there. We shall need uniform bounds and establish them in the next 
two lemmas. By [3i Theorem 1], for any x G M", gk{x) is an asymptotically unbiased estimator 
for gxoix), if efe — )■ as — > oo. We shall show that this holds uniformly in x. 

Lemma 6.1. Suppose that Kq, Sk, and g^ are as in Algorithm NoisyCovDiff(ip). For each 
keN andx e M", 

\E{gk{x)) -gKo{x)\ <n{ek + l/k). 
Consequently, gk is uniformly asymptotically unbiased whenever limk^oo^k = 0. 



Proof. Using (61), (62), and the definition of v?ej., we obtain 



(64) \E{gk{x))- gK^{x)\<^)^\gK^{xiu)- gK„[x)\ \ ipe^ix-z)dz, 

i=l J(l/k)C^+x,k 

for all X G W\ The support of (p^k is contained in SkCQ, so for fixed x, the support of the 
integrand 'Pski^ ~ ^) is contained in EkC^ + x. Now if Xik ^ {ek + l/k)CQ + x, then SkC^ + x 



and {l/k)C^ + Xik are disjoint, so the corresponding summand in (|64l) vanishes. Moreover, for 



Xik € i^k + ^/k)CQ + X, Corollary 3.3 and the fact that the diameter of Cg is ^/n imply that 



\9KoiXik) - gKo{x)\ < n{6k + l/k). 
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Consequently, 

Ik p 

\E{gk{x)) - gKo{x)\ < n(£fc + 1/A;) / ifek{x-z)dz 

< n{ek + l/k) Lpe^{x - z)dz = n{ek + llk), 

as required. □ 

In [21 Lemma 1], a polynomial rate of convergence result in the weak sense is established 
for independent identically distributed measurement errors with polynomial tails. In contrast, 
we assume only uniformly bounded fourth moments and obtain a convergence rate that holds 
uniformly, using the Lipschitz continuity of the covariogram. 

Lemma 6.2. Suppose that Kq, Sk, and gk are as in Algorithm NoisyCovDiff'((f) and let 6 > 
and limfc_>oo£^fc = 0. Then there are constants Ci2 = Ci2{^) and N4 = N4{{ek),n) G N such 
that 

(65) Pr {\gk{x) - gKo{x)\ > 6) < qui2k + l)"r^(fefc)-3", 

for all k > and all x E M". 

Proof. Let x G M" and A; G N be fixed and define 



(66) /3ik = Pikix) = / lpe^:{x - z) dz, 

J{l/k)CS+x,k 

for i = 1, . . . , Ik- Then 

(67) Afc < ||<^,J|ooV^((lA)Co") = ll^lloo(fefe)-" 
and 



(68) 



^Afc< / (fek{^-z)dz = l. 
i=l 



In view of (61), (62), and (66) 



gk{x) - E {gk{x)) = ^ (3ikN, 



ik 

1=1 



is a sum of zero mean independent random variables. The assumption that the NikS have 
uniformly bounded fourth moments implies that E (|A^jfc|^) < C for some constant C and all i 
and k. Now, using Markov's inequality, Khinchine's inequality (see, for example, [221 (4.32.1), 
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p. 307] with a = 4), (67), and (68), we obtain 

PT{\gk{x)-E{gk{x))\>6/2) < {6/2)-'E 



< 



< 




< cC6''h{y\\oo{kekrfJ2f^^k 



i=l 



(69) 



-3n 



for all 6 > 0, where c is a constant and qrs] = cC||(y9||J^. By Lemma 6.1, there is a constant 
T^ = A^((£fc),n) G N such that for all k > A^and x G M", we have \E {gkix)) - gKoix)\ < 6/2 
and therefore 

Pr (l^fc(x) - gKo{x)\ >6) < Pr {\gk{x) - E {gk{x)) \ + \E {gk{x)) - gKo{x)\ > 6) 

< Pr i\gkix)-Eigkix))\>6/2). 



Now (65) follows from this and (69). 



□ 



For a convex body K in M" and 5 > 0, let K{5) = {x G : gxix) > S}. Since is 
concave on its support, K{6) is a compact convex set, sometimes called a convolution body 
of K. References to results on convolution bodies can be found in [20l p. 378]. 

Lemma 6.3. Let K be a convex body in M". If < 6 < V{K), then 



DK C K{6). 



Proof. Let t = {S/V{K)Y/'^ and let x G (1 — t)DK. Since DK is the support of gx-, there is a 
y in the support of gx such that a; = (1 — t)y + to. As g]!^^ is concave on its support, we have 

9K{xf''' > (1 - t)gK{yf'- + tgK{of!- > tV{Kf/- = 5^/\ 



It follows that X G K{5). 



□ 



Theorem 6.4. Suppose that Kq, 5k, £k, ond g^ are as in Algorithm Noisy CovDiff(ip ). Assume 
that Yrnvk^oo ^k = hnifc^oo 5k = and that 



(70) 



liminf5^4"r-3/2 > 0. 



fe— >-oo 
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Let Ci3 > y/n(2/V{Ko) Y^'^ . If Qk is an output from Algorithm Noisy CovDiff(Lp) as stated 
above, then, almost surely, 

(71) S{DKo,Qk)<qi3p'J'', 

for sufficiently large k. In particular, almost surely, Qk converges to DKq, as k ^ oo. 
Proof. Let 

ak= max \gk{x) - gKo{x)\. 
By Lemma 6.2 and (70), we have 

Pr(afe>(5fc) < P^ilgkix) - gK,Xx)\ > Sk) 

x£2CSn{l/k)Z" 

< qT2](2A; + l)2"5-4(fe,)-3- = 0(fc-3/2)_ 

Therefore, by the Borel-Cantelh lemma, we see that, almost surely, < Sk for sufficiently 
large k. Fix a realization and a G N such that < 6k and 

(72) (^]"\^<1 



where s{Ko) = max{p > : pCp C DKq}. As < 6k, the definition (63) of Sk implies 

Koi26k) n ^Z" cSkC DKo. 
The set on the left is o-symmetric, and DKq is convex and o-symmetric, so 



(73) conv ( Ko{26k) n ^Z" ) C C DKq. 



We claim that 

(74) Ko{26k) e C conv (^Koi26k) n 

where Minkowski difference is defined by (|2|. Indeed, let x G i^o(2(5fc) {3/k)CQ. As 
+ (1/A;)Q : y G (1/A;)Z"} is a covering of M", there is a ?/ G (1/A;)Z" with x G (1/A;)Q + ?/ 
and hence y G (1/A;)Cq + x. It follows that 

X G ^(2Q) + y C ^Co" + X C iro(25fc). 

As the vertices of (1/A;)(2Q) + y are in (1/A;)Z", we have x G conv {Ko{26k) n (1/A;)Z"), 
proving the claim. 

Let tk = {26k/V{KQ)Y^'^. The fact that DKq is convex and contains the origin, ( [72) ), 
Lemma 6.3 (with 6 = 26k), and the definition of s{Kq) imply that 
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From this, (74), and (73), we obtain 

1-14 + 



s{Ko)k 



As DKq C 7^5", this yields 



6{DKo, Qk)<V^{tk + 



l/n 



+ 



-l/n 



By (70), ^ 



l/n 



oo as — 7- oo, and (71) follows. 



□ 



The estimate ( 71 ) reveals that the rate of convergence of Qk to DKq depends on the 
asymptotic behavior of the threshold parameter 6k, which is linked to the bandwidth Sk by 
(|70[. If we 

assume that V{Kq) is bounded from below by a known constant, then qr^in the statement 
of Theorem 6.4| can be chosen independent of K^. We note the resulting rate of convergence 
as a corollary, where we choose Ek and 6k as appropriate powers of k. In particular, it shows 
that a convergence rate of k~P can be attained, where p is arbitrarily close to 1/4 — 3/{8n). 

Corollary 6.5. Suppose that Kq, 6k, Sk, and gu are as in Algorithm NoisyCovDiff((p). Let 
<b< V{Ko), let 6k = A;-("-3°"-3/2)/4^ ^nd let Ek = fc"", for some < a < 1/3 - l/(2n). // 
Qk is an output from Algorithm NoisyCovDifJ(ip) as stated above, then, almost surely, 

l/n 

^_(l_3„_3/(2n))/4 



6{Qk,DKo)<V^(^^^ 



for sufficiently large k. 



Remark 6.6. Here we outline how a stronger assumption, but one that still applies to all 
the noise models of practical interest, on the random variables in Algorithm NoisyCovDiff((y9) 
leads to a better convergence rate in Corollary |6.5 



Consider a family {X^ : a G A} of zero mean random variables with variances cx^ that satisfy 
the hypothesis of Bernstein's inequality (see [HI Theorem 5.2, p. 27] or ^91 Lemma 2.2.11]), 
that is, 



(75) 



771 ' 

\EiX:;)\<-alH--', 



2,3, ... , and also have uniformly bounded variances. 



for some H > and all a G A and m 
that is, 

(76) 

say, for all a & A. If the family {Xi, . . . ,Xr} of independent zero mean random variables 
~ {1, 



^2 ^ 2 



satisfies ( 75 ) with A 



r}, then Bernstein's inequality states that 
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for all 6 > 0. 

Suppose that the random variables Nik in Algorithm NoisyCovDiff((y9) are row-wise inde- 
pendent, zero mean, and satisfy (75) and (76). Then Bernstein's inequality can be applied in 
the proof of Lemma 6.2, together with (67) and (68), to show that 



(77) 



FT{\gk{x) - E {gk{x)) \ > 6/2) < 2exp 



for all 5 > 0. (Compare the weaker upper bound in (69).) As at the end of the proof of 
Lemma |6.2[ this results in the same upper bound for Pr ( gk{x) — gx^ix)] > 5). The improved 
bound (|77l), combined with the argument of Theorem 6.4, leads to the assumption 



(78) 



liniinf^^i^>Ci4(n + 2), 
fc-5-oo log k 



where 12||y9||ooO"^, instead of (70). In Corollary 6.5 we take instead 5k = log A; 

and Ek = k~°', for some < a < 1. The final conclusion is that if Qk is an output from 
Algorithm NoisyCovDiff (</?), then, almost surely. 



6{Qk,DKo 



< 



l/n 



k-(^-^)/\iogky/^, 



for sufficiently large k. In particular, a convergence rate of k~~P can be attained, where p is 
arbitrarily close to 1/2. 

Note that families of zero mean Gaussian and centered Poisson random variables satisfy 
(75) and (76). Also, if two independent families with the same index set satisfy (75) and (76), 
the same is true for their sums (with possibly different constants H and o"^). 



7. Phase retrieval: Framework and technical lemmas 

In this section we set the scene for our results on phase retrieval, beginning with the nec- 
essary material from Fourier analysis. 

Let 5^ be a continuous function on whose support is contained in [—1, 1]" and let L > 1. 
By the classical theory, the Fourier series of g is 



E 

zeZ" 

for X G [~L, L]", where 



^ ^ 9{t)e~'^''''^ dt = ! g{t)e-''^'-''^dt= -\—g{Txz/L). 



{2LY Jy_^^^^^'' ' {2LYJ^^''' (2L) 

Let 

Zl = {z : z = {zi,...,Zn), \zj\ < k,j = l,...,n}. 
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If g is also Lipschitz, then by |i35i Theorem 3], the square partial sums J2z&" Czt™'''''^^^ of the 
Fourier series of g converge uniformly to g. Therefore, if g is also an even function, we can 
write 

(79) 9{^) = 7^ E = 7^ E ^(-^/^) 

for all X G [—L^ L]", where equality is in the sense of uniform convergence of square partial 
sums. 

Let Z^(+) be a subset of such that 

(80) z^(+) n (-Z^(+)) = and = {o} U Z^(+) U (-Z^(+)) . 

Suppose that g is even and for some fixed < 7 < 1 and each A; G N, we can obtain noisy 
measurements 

(81) gz,k = 9{z/k^) + 

of g, for z G {0} U Z^(+), where the ^'s are row-wise independent (i.e., independent for 
fixed k) zero mean random variables. Define X^^k = ^-z,k, for -2 £ (~^fc(+)) ^'^d note that 
then Xz^k = X-z,k for all z G Z^. Since g is even, ^ is also even, and we have gz,k = g~z,k for 
z G Z^. Using these facts, (79) with L = nk'^, and (81), we obtain 
(82) 



1 _ Z ■ X , , 1 / Z ■ X ^-^ ^ f 

, , > Qzk COS — — = q(x) + . , , > Xzk COS — > q [ - 



z ■ X 

cos 



(27rk^)^^^ ' ky ' (27rky)^ \ ^ ' k^ ^ ^ Kk^ J k^ 

for all X G [— ttA;'^, vrA;'^]"'. Here the left-hand side is an estimate of g{x) and the second and 
third terms on the right-hand side are a random error and a deterministic error, respectively. 

Since it has all the required properties, we can apply the previous equation to the covari- 
ogram g = g^^ of a convex body Kq contained in Cq, in which case g]^ = jlft-oP- In order to 
move closer to the notation used earlier, we now use i as an index and again list the points 
in [-1,1]" n (1/A;)Z" = (1/A;)Z^, but this time a little differently. We let xok = o, list the 
points in (1/A;)Z^(+) as Xik, i = 1, . . . = {{2k + 1)" — 1) /2, and then let Xik = — for 
i = —I'j., . . . , —1. Now let Zik = k^~'^Xik, so that 

{l/k^)Zl = {z,k■.^ = -I'k,...,I'k}. 



Setting gjk = Qkoz^^ k ^"^^ ^jk = ^zjk,k-, we use (81) to rewrite (82) as 



(83) Mk{x)= gK^{x) + Nk{x)-dk{x), 

where 



I', 



1 

(84) Mk{x) = ^^^j^^y cos(zjfc ■ x)gjk 
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is an estimate of gxo, 

1 

(85) Nk{x) = ^°^(^i^ ■ 
is a random variable, and 

(86) ^^(^) = /27rL)" 5Z cos(^)^(z/F) 

is a deterministic error. 

We shall need three technical lemmas. The first of these provides a control on the deter- 
ministic error. 

Lemma 7.1. Let 4 = sup{|4(x)| : x E M"}. Then 4 = 0(A;'^~^(log A;)") as k oo. 

Proof. From (86), the fact that 'g]^ = \Ikq\'^ is nonnegative, and (79) with g = g^o and 
L = Tck"', we have 

(87) ^^^(^^ E »A")=^i^o(0)-7^^E»A')- 
For t e M, let 

^ A , _ s,..((>:+ 1/2)0 
be the Dirichlet kernel. Note that for x = (xi, . . . , x„) G M", we have 



n / k 



zez^ i=i \i=-fe / 1=1 



Xi). 



Using this and the fact that gxo is even, with support in [—1, 1]", we obtain 



n 

9Koix)YlDk{-Xi/k'^) dx 



1=1 

n 



[-1,1]" 



(=1 



Since J^^ Dk{t) dt = 27r, we have 

If " 

(89) g^^(0)= (7^„(0)JlDfc(y,)rfy. 
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Thus, by (fSTl), (g, and Q, 



dk < 



(90) 



(27r)" 



1 



YlDk{yi)dy 



+ 



(27r)" J[-n,n]"\[-l,l]" Jl^ 



By Proposition |3^, gx^ is Lipschitz and hence the Lipschitz norm of QKoiyk"') is 0{k'^). Now 
|35t Theorem 1] imphes that 



(91) 



(2vr) 



1,1]" 



1=1 



n— 1 



<ci5F-i5^(logA;)"-', 



1=0 



for some constant grgi independent of A;. (In the statement of Theorem 1], Dj(Y) should 
be Dj{Y). In that theorem we are taking a = 1 and J = {k,k, . . . ,k) & Z".) 
In view of ( 90 ) and (91), the proof will be complete if we show that 

/n 
l[Dk{xi)dx = 0{l/k), 
^ -7r,7r]"\[-l,l]" 

as — )• oo. To this end, observe that, by trigonometric addition formulas and integration by 
parts, 

-1 



Dk{t)dt= / Dk{t)dt 



dt -\- cos{kt) dt 



^ sin(H) cos(t/2) 
sin(t/2) 
cosfccot(l/2) r cos{kt) d 



(93) 
Now 

where 



k 

Oil/k). 



k dt 



(cot(t/2)) dt - 



sin k 



-7r,7rr\hl,ir = UlLi(A,Ui?,), 



Ai = {{xi, . . . , Xn) : —1 < Xj < 1 foT j < i ,1 < Xi < n, — tt < Xj < tt for j > i} 



and Bi = —A^. By (93), we have, for each i, 

>i 



'^Dk{xi)dx 



1=1 



Dfe(t)c?t / Dfe(t)rft / Dkit)dt 



{2n -0{l/k)y-' 0{l/k) (27r 



Since int (Ai) fl int (Aj) = 0, for each i,j with i ^ j, int (Ai) fl int (5^) = 0, for each z, j, and 
nr=i ^k{xi) is even, the previous estimate proves (92). □ 
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It is possible that the previous lemma could also be obtained via some estimates proved in 

for the rate of decay of Jg„-i \1ko{^u)\'^ as r — )■ oo. 
The next two lemmas will allow us to circumvent Proposition 4/7, the version of the Strong 
Law of Large Numbers used earlier. 

Lemma 7.2. Let Yjk, j = 1, . . . , ruk, k be a triangular array of row-wise independent zero 
mean random variables with uniformly bounded fourth moments, where ruk ~ fc" as k ^ oo. 
Let V and apqk, p,q = 1, . . . , nik be constants such that \apqk\ = 0{k^) as k ^ oo uniformly in 
p and q, where 2n — 4n7 + 2t/ < —1. Then, almost surely, 

as A; — 7- oo. 

Proof. Note that E(YpkYqk) = E{Ypk)E{Yqk) = unless p = q. Therefore 

^ ^ p,q=l ^ ' p=l 

Since the l^^'s have uniformly bounded second moments, = 0(A;"~^"'^^'^) and hence 

E{Zk) converges to zero as /c — )■ cxd. 
Let 

Viqls = COV {YpkYqk, YrkYsk) = E{YpkYqkYrkY,k) " E{YpkYqk)E{YrkYsk) . 

If the cardinality of the set {p, q, r, s} is 3 or 4, then at least one of the indices, say p, is 
different from all the others and 



V. 



= EiYpk)E{YqkYrkYsk) - E{Ypk)E{Yqk)E{YrkYsk) = 0-0 = 0. 



If the cardinality of the set {p, g, r, s} is 1, then 

"^pqrs ^pppp 

If the cardinality of the set {p, q, r, s} is 2, then either p = q, r = s and p r, and 

'^pqls = "^pprr = ^O^pk^rk) ~ -^(^fc)-^(^rl:) = 0) 

or p = r, g = s and p ^ q, and 

= ^S, = EiYiyqk) - E{Yp,Yq,f = EiYi)EiY^l) - E{Yp,fE{Yq,)\ 
or p = s, q = r and p ^ q, and 

^SL = = EiY^kYl) - EiYp,Yq,y = E{Y;,)E{YI) - E{Yp,fE{Yq,)\ 
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In view of the fact that the Yj^s have uniformly bounded fourth moments, the covariances 
Vpqrs are also uniformly bounded, and hence 



(k) 

p,q,r,s=l 



^ nik ^ / mk rrik 

^ppk'^iplp + (r,„Uj\4n %qk'"lqlq + X] ^PgkO'QPk'^' ^ 



M'jiJ^-y^'in PPi^ PPPP \ ^ ^pqk"pqpq ' ^pqit^qpK-- pqqp 

Let e > 0. For sufficiently large k, we have e — E{Zk) > 0, and for such k, by Chebyshev's 
inequality, 

Pr(Z, >e)= Pt{Z, - E{Z,) > e - E{Z,)) < ^^^^'jg^^, = O (e^-^-^^^-^) . 

Our hypothesis and the Borel-Cantelli Lemma imply that, almost surely, Z^ converges to zero, 
as — 7- 00. □ 

(r) 

Lemma 7.3. Let ^7, ? j = l,...,mk, r = 1,2, A; G N, be a triangular array of row- wise 
independent (i.e., independent for fixed k) zero mean random variables with uniformly bounded 
fourth moments, where nik ~ fc" as k ^ 00. Let v and Opqk, P,q = 1, . . . ,mk be constants 
such that \apqk\ = 0{k^) as k ^ 00 uniformly in p and q, where 2n — Any + 2z/ < —1. Then, 
almost surely, 

7, - \^ n , V«v(2)y(l)y(2) , r. 

~ (2TTk^Y"' ^ "'Plf'^pk ^pk Uk ^qk ~^ 

as A; — 7- 00. 



Proof. As in the proof of Lemma 7.2 , we have 



so \E{Zk)\ = 0(fc"~^"'^"'"'^) and hence E{Zk) converges to zero as — )■ 00. 
Let 

/'y(l)y(2)y(l)y(2) ^(1)^(2)^(1)^(2) 
"Jpqrs — y-'^pk ^pk ^ qk ^ qk ^ rk ^ rk ^ sk ^ sk 
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Straightforward modifications to the proof of Lemma 7^ and the assumption of uniformly 
bounded fourth moments yield 

^ p,q,r,s=l 



X/ '^Ppk^PPPP + i ^ '^pqk'^pqpq + ^pqk^^qpkW^pqlj 



The proof is concluded as in Lemma 7.2 □ 



8. Phase retrieval from the squared modulus 
This section addresses Problem 2 in the introduction. 

Algorithm NoisyMod^LSQ 

Input: Natural numbers n > 2 and fc; a real number 7 such that < 7 < 1; noisy 
measurements 

(94) Qik = |lxo(^ifc)P + Xik, 

of the squared modulus of the Fourier transform of the characteristic function of an unknown 
convex body Kq C Cq whose centroid is at the origin, at the points in 

{z,, : z = 0, 1, . . . , /a = W U 



where Z^(+) satisfies (80) and where the Xj^'s are row-wise independent zero mean random 
variables with uniformly bounded fourth moments; an osymmetric convex polytope Qk in M", 
stochastically independent of the measurements Qik, that approximates either VKo or DK, in 
the sense that, almost surely, 

lim S{Qk, VKo) = 0, or lim 6{Qk, DKo) = 0. 

Task: Construct a convex polytope Pk that approximates Kq, up to reflection in the origin. 
Action: 

1. Let gik = g{-i)k, for i = -I'f,, . . . , -1, let Xik = k^~'^Zik, i = -4, . . . , 4 be the points in 
the cubic array 2Q n (1/A;)Z", and let 



(95) 



1 ' 

Mk{xik) = , - Yl cos(2;jfc ■ Xik)gjk, 



fori = -4,..., 4. 



2. Run Algorithm NoisyCovLSQ with inputs n, k, Qk, and with Mik replaced by Mk{xik), 
for i = —I'f,,...,I'i, and with the obvious re-indexing in i. The resulting output Pk of that 
algorithm is also the output of the present one. 
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The main result in this section corresponds to Theorem 4.10| above. We first state it, and 
then show that it can be proved by suitable modifications to the proof of Theorem 4.10 if in 
addition 7 > 1/2 + l/(4n). 

Theorem 8.1. Suppose that Kq C Cq is a convex body with its centroid at the origin. Suppose 
also that Kq is determined, up to translation and reflection in the origin, among all convex 
bodies in M", by its covariogram. Let 

(96) 1/2 + l/(4n) < 7 < 1. 

If Pk, k ^N, is an output from Algorithm NoisyMod'^LSQ as stated above, then, almost surely, 
as k ^ 00. 

As we shall now show, the proof of this theorem basically follows the analysis given in Sec- 
tion |4j Of course, alterations must be made, since the measurements Mj^ in Algorithm Noisy- 
CovLSQ have been replaced by the new measurements Mk{xik) defined by (95) or equivalently 
by (84) with x = Xik- In view of (83), we have 

Mk{xik) = gxoixik) + Nk{xik) - dk{xik), 



i = — /^,...,/{., where Nk{xik) and dk{xik) are given by (85) and (86), respectively, with 

X Xik- 

We begin with a lemma. Note that Ik = 2/^ + 1, so the expression in the lemma is the 
sample mean. Also, recall that by their definition, the random variables X^k have uniformly 
bounded fourth moments, and Xpk and Xgk are independent unless p = ±q, in which case 
they are equal. 



Lemma 8.2. Let Nk{xik)^ = max{A^fc(a;jfc), 0} for all i and k. If (96) holds, then, almost 
surely, 

1 

- V NkixikY ^ 0, 

ik ■^■^^ 

as k —> 00. 

Proof. Note firstly that 

- V Nkixik)^ <-r y2 Wk{^ik)\ < It M^ik) 

Thus it suffices to prove that, almost surely, 

1 

Sk = -rY^ Nk{xikf ^ 0, 

J k 

as /c —7- 00. 




PHASE RETRIEVAL FOR CHARACTERISTIC FUNCTIONS OF CONVEX BODIES 



41 



We have 



Sk 



1 * / 1 



{2TTk 



Ik 

" i=-lL 



(27rA;T) 



2n 



qki 



say. Since C(^-p)qk = Cp(-q)k = Cpg^, it is clearly enough to show that, almost surely, 



(27rA;T) 



1 

r.7N2n E '^PQkXpkXqk 0, 



p,g=l 



as /c — )■ oo. In view of (96) and the fact that \cpgk\ = 0(1), this follows from Lemma 7.2 with 
Yjk = Xjk, rrik = I'k, apqk = Cpqk for all p, q, and k, and z/ = 0. □ 

Proof of Theorem 8. 1 We shall indicate the modifications needed in Section |4j No changes are 
required in the lemmas before Lemma 4.4 For the latter, we shall use the same notation as 
before, with the understanding that the indexing has changed and the new random variables 
Nk{xik) replace the random variables Nik of Section lil Thus we write 



1/2 



i=-iL 



with corresponding changes in indexing in the definitions of x/^, N/^,, and With the same 
proof as Lemma 4.4, we now have the inequality 

\gK,-gp,\\ < 2^(Pfc,x,,,N,J -2^(P(a) nCo",x,,,N,J + \gj,^-gp^^^^cs\l + 



(97) 



+Y E {9P{a)nc^{xik) - gp^{xik)) d 

J- k 



k \Xik J 



instead of (34). 



Proposition 4.5 and Lemma 4.6 are unchanged. We do not require Proposition 4.7 in order 
to conclude as in Lemma 4.8 that, almost surely. 



(98) 



sup ^(ir,X4,N/J ^ 0, 
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as A; — )■ oo. Indeed, it is enough to show that, almost surely, the new expression corresponding 



to (37), namely. 



Wk{e) 



max 

j = l,...,m 



1 ''- 



Xik)Nk{xik) 



1 

4 



^ 9}{xik)Nk{xik)' 



converges to zero, as A; — ?■ oo. This follows from Lemma 
and {xik) are uniformly bounded by 1 and Lemma 
inserted and when Nk{xik)^ is replaced by Nk{xik)~ = 



8.2 



8.2 



because the coefficients gf{xik) 



holds both when such coefficients are 

Nk{xik)-Nk{xiky = max{-Nk{xik),0}. 



All this is enough to ensure that Lemma |4.9| still holds. Indeed, since a translate of Pk is 
contained in Cq, and \E'(Pfc, x^, N/^.) is unchanged by such a translation, we know from (98) 



that, almost surely, the first and second terms on the right-hand side of (97) converge to zero 



as A; — )• oo. We have gp{a)r\C'^{xik) < 1 and gp^.{xik) < V{2Cq), since Pk C 2Cq, and then 
Lemma 7.1 implies that the new fourth term on the right-hand side of (97) converges to zero 



as Ac — >■ oo. The rest of the proof of Lemma 4.9 proceeds as before. 



The proof of the main Theorem 4.10 now applies without change. 



□ 



The user of Algorithm NoisyMod^LSQ must supply as input an o-symmetric convex poly- 
tope Qk in that approximates either VKq or DK. For this purpose we provide two algo- 
rithms that do the work of Algorithm NoisyCovBlaschke and Algorithm NoisyCovDiff 

Algorithm Noisy Mod^Blaschke 

Input: Natural numbers n > 2 and k; a positive real number hk, mutually nonparallel 



vectors Ui G S' 
(99) 



n-l 



k that span M"; noisy measurements 

|lxo(^ifc)P + ^ik, 



9ik 



of the squared modulus of the Fourier transform of the characteristic function of an unknown 
convex body Kq C Cq whose centroid is at the origin, at the points in 

{z,, : z = 0, 1, . . . , /a = W U (1/F)Z^(+), 



where Zi^(-I-) satisfies (80) and where the Xi^s are row-wise independent zero mean random 
variables with uniformly bounded fourth moments. 

Task: Construct an o-symmetric convex polytope Qk that approximates the Blaschke body 
ViTo. 

Action: 

1. Let gik = g(-i)k, for i = . . . , -1, and let 



T' T' 

^fc 1 

^^^^^ " (27rA:'>)" ^ ^^'^ Mk{hkU^) = jtj^^^ J] cos(zjfc ■ hkUi)gjk 



{2Tik^y 
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for i = 1, . . . ,k. Then for i = 1, . . . , A;, let 

Mk{o) - MkihkUi) 

(100) yik = r • 

Ilk 

2. With the natural numbers n > 2 and k, and vectors Ui G S*""^, i = 1,. . . ,k use the 
quantities instead of noisy measurements of the brightness function hxiui) as input to 
Algorithm NoisyBrightLSQ (see [211 p. 1352]). The output of the latter algorithm is Qk- 



We shall show that the argument of Section [5] can be modified to yield a convergence 



result corresponding to Theorem 5.4 It is clear that any such result must require the input 
hk to satisfy /i^ — as /c — )■ oo, but we need a stronger condition phrased in terms of 



parameters e and 7 that satisfy (101). Since the second inequality in (101) is equivalent to 



7 > i2n + 5 — As) /{An + 4), which decreases as n increases and equals (9 — 4e)/12 when 
n = 2, it is possible to choose 7 and e so that (101) is satisfied. Specifically, one can choose 
3/4 < 7 < 1 and < e < 1 - 7. Note also that Mil) implies (|96]). 



There is considerable flexibility in the choice of the parameter hk-, and it would be possible 
to introduce a further parameter qk by working with input vectors Ui G S*""^, i = 1, . . . ,qk, 
where — >■ 00 as /c — )■ 00. To avoid overcomplicating the exposition, however, we shall not 
discuss this any further. 

Theorem 8.3. Let Kq C Cq be a convex body with its centroid at the origin. Let {ui) be a 
sequence in S"^^ such that (u*) is evenly spread. Suppose that hk ~ k'^~^~^'^ , G N, where e 
and 7 satisfy 

(101) 0<£:<l-7 and 2n - 4n7 + 4(1 - 7 - £:) < -1. 

If Qk is an output from Algorithm NoisyMod"^ Blaschke as stated above, then, almost surely, 

lim <5(Vi^o, Qfc) = 0. 



Proof. We shall indicate the changes needed in Section [5j Note that by (100), and (83) with 
X = and X = hkUi, we have 

_ Mfc(o) - MkjhkUi) _ gKojo) - QKoQikUj) Nk{o) - Nk{hkUi) dk{o) - dk{hkUi) 

Dik , , "T 



hk 



hk 



hi 



hk 



for z = 1, . . . , A;, where Nk{o), dk{o), Nk{hkUi), and dk{hkUi) are given by (85) and (86) with 
X = or X = hkUi, as appropriate. 



Lemma 3.1 is unchanged. Turning to the proof of Lemma 5.1, we now have 

Uik Cik ~l~ ^iki 



where 



(102) 



Cik 



9Ko{o) - gKoihkUi) dk{o) - dkihkUi 



hi 



hk 



and T,- 



ik 



Nk{o) - NkjhkUj 
hk 
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for i = 1, . . . ,k. Since hk ~ k'^~'^~^'^ for < £ < 1 — 7, the second term in the previous 
expression for Qk converges to zero as /c — )■ 00, by Lemma 7.1, and hence Qk — ^ bxoiui) as 
/c — )■ 00, as before, for i = 1, . . . , fc. Moreover, 

9Ko{o) - 9Ko{hkUi)\ dk{o) - dk{hkUi) 



hi 



hi 



so arguing as in the proof of Lemma |5.1 , we use Lemma 3.1 with t = hk to obtain (46) with 
t = hk, that is. 



< bxoiui) - 
if hk < 2r. We also have 



9Koio) - 9KoihkUi) (n - l)hk 

OKo[Ui), 



hk 

dk{o) - dkjhkU 
hu 



2r 



o{k-n, 



by Lemma 7.1, so there is a constant Cig = Ci6(n, r) such that 

\bKoiui) -Cik\ < qi#"'', 

for P = mm{e, 1 — 7 + e}, and all A; G N and i = 1, . . . , k. The rest of the proof of Lemma 5.1 
can be followed, yielding that, almost surely, there is a constant C17 = Ci-j{n,r) such that 

(103) \bKo - bQ,\l < 2^{Qk, (n,),Tfc) - 2^{Ko, (n,),Tfc) + ^|6ko - 

for all k eN. (Again, we assume that the obvious changes are made in the notation.) 

The next task is to check that Lemma 5.2 still holds. With (103) in hand, this rests on 
proving that, almost surely, 

k 



2 

i=l 



is bounded. In fact we claim that, almost surely, V^,. — ?■ as A; — ?■ 00. To see this, note that 

1 ^ / Nk{o) - Nk{hkUi 



Vk 



i=l 
k 



hi 



k ^ \ (27rA;T)" ^ 



1 - cos{zjk ■ hkUi) 



hk 



X 



jk 



{2'nk 



qki 



P'1=-^'k 



where 
(104) 



''pqk 



1 ^ 

^ ^(1 - cos(zpfc • hkUi)) (1 - cos{zqk ■ hkUi)) 

k j^—i 
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and hence \apqk\ < ^/h\. As in the proof of Lemma 8.2, we may take the indices p, q from 1 to 
/[, and then, by (101 ), the claim follows from Lemma 7.2 with irtk = and u = 2(1 — 7 — e). 

At this stage the work for Lemma 5^ is already done. Indeed, by the Cauchy-Schwarz 
inequality. 



1/2 



i=l 



\b 



1/2 



Using this and (103) we see that, almost surely, 

\bKo - b 



< 2V,'^ + 



1/2 



^0, 



as /c — )■ 00. 



Finally, the proof of Theorem 5.4 can be applied without change. 



□ 



The next algorithm corresponds to Algorithm NoisyCovDiff((/?). As for that algorithm, is a 
nonnegative bounded measurable function on M" with support in Cq , such that Jjg„ '{>{x) dx = 
1. 

Algorithm NoisyMod^DifF((/?) 

Input: Natural numbers n > 2 and k; positive reals Sk and Ek, a real number 7 satisfying 
< 7 < 1; noisy measurements 



\lKo{z^k)\^ + 



iki 



(105) Qik 

of the squared modulus of the Fourier transform of the characteristic function of an unknown 
convex body Kq C Cq whose centroid is at the origin, at the points in 

{z,, : z = 0, 1, . . . , /a = W U (1/F)Z^(+), 



where satisfies (80) and where the Xj^'s are row-wise independent zero mean random 

variables with uniformly bounded fourth moments. 

Task: Construct an o-symmetric convex polytope Qfc in I^" that approximates the difference 
body DKq. 

Action: 



1. Let Qik = g{-i)k, for i = -J^, . . . , -1, let Xik = k"^ ^z, 



ik ) ^ 



k-i ■ 



be the points in 



the cubic array 2Q n (1/A;)Z", and let 



(106) 



for i 



Mk(xik) 



1 



(27rA;T)" 



E 



cosu 



jk ■ 



Xik) 9, 



'jk, 



-T' r 

^ki ■ ■ ■ ■> -'fc- 



2. Run Algorithm NoisyCovDiff((y9) with inputs n. A;, 5^, Sk, and Mj^ replaced by Mk{xik), 
for i = —I'f., ■ ■ ■ ,1'f. and with the obvious re-indexing in i. The output Qk of that algorithm is 
also the output of the present one. 
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We shall show that the argument in Section |6] used to prove Theorem 6^ can be modified 
to yield the following convergence result. 

Theorem 8.4. Suppose that Kq, 6^, Sk, and are as in Algorithm NoisyMod'^Diff(ip). As- 
sume that limfc^oo = lini/c^oo ^fc = and that 



(107) 



liminf(5^A;^^"-3"-^/2 > 0, 



where 7 > 3(1 + l/(2n))/4. If Qk is an output from Algorithm NoisyMod"^ Diff(ip) as stated 
above, then, almost surely, 

for sufficiently large k. In particular, almost surely, Qk converges to DKq as k ^ 00. 

Proof. Algorithm NoisyMod^Difi^(y9) can be regarded formally as Algorithm NoisyCovDifF(<^) 
with Mjfc and N^^ replaced by Mk{xik) defined by (106) and Nk{xik) — dk{xik) defined by 
(85) and (86) with x = Xik, respectively. We follow the arguments of Section [6] with this 
substitution in mind. 



For Lemma 6.1, we note first that by (85), E(Nk(xik)) = for all i and k. The same 
calculations as in the proof of Lemma 6A_ lead to 

\E{gk{x)) - gKo{x)\ < n{ek + l/k) + 4, 

where dk is as in Lemma |7.1[ By that lemma, 4 as A; — ?■ 00 and hence the second 
statement in Lemma 16.11 still holds. 

Next, for Lemma 6.2, recall the definition (66) of Pik{x). Then we have, by (85), 



gkix) - E{gk{x)) 



Pik{x)Nk{ Xik ) 

1 I \ 

Yl f^ikix) cos{zjk ■ x,k) 



{2'nk^y 



1 



3=-I'k 



say. This is a weighted sum of independent random variables, so we can apply Khinchine's 
inequality (see, for example, [29l (4.32.1), p. 307] with a = 4) to obtain 



E 



^ Pik{x)Nk{xik) 



(27rfcT) 



4?! 
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for some constant c > 0. Also, 



< 1, 



by (68). The same argument as in the proof of Lemma 6.2 now leads to the conclusion that 

cisi^) and A^g 

-4 



there are constants Cig 
(108) Fi{\gkix) - gKoix) 

for all k > A^and all x G M". (Compare (65). 



= N5{{£k),n) G N such that if 5 > 0, then 



Lemma 16. 3 1 is unchanged. With (107) instead of the hypothesis (70) of Theorem 6.4, and 



the new estimate (108), we arrive in the proof of Theorem 6.4 at the estimate 

Pr(afc > 4) < qill(2A; + l)^"^-^^"^-^ = 0(^-^/2), 
so the Borel-Cant elli lemma can be used as before. This is all that is required to allow the 



proof of Theorem 6.4 



same, namely that, a. 



to go through until near the end, when we use the fact that A;5 



l/n 



—7- OO 



as /c — )■ oo. By (107) and the fact that 7 < 1, this still holds. Then the conclusion is the 

most surely. 



for sufficiently large k. 



□ 



Concerning Corollary 6.5, by using 7 > 3(1 + l/(2r2))/4 and (107) instead of (70), we 



can achieve a convergence rate arbitrarily close to /j;-i/4+3/(8n.)^ ^^le same as before. If we 
assume instead that the random variables Xj^ in Algorithm NoisyMod2Diff((y9) are row-wise 
independent, zero mean, and satisfy (75) and (76), that 7 > 1/2, and that 



52^"{27-l) 

lim inf — — 

fc^.oo log k 



(109) 

where = c^n, a) 
tained by the methods outlined in Remark |6.6 



> Cig{n + 2), 

(3"^2cT2)/((27r)2"), then a rate arbitrarily close to k^^^"^ can be ob- 



9. Phase retrieval from the modulus 

This section addresses Problem 3 in the introduction. A simple trick converts Problem 3 
into one very closely related to Problem 2, considered in the previous section. 

Suppose, more generally, that noisy measurements are taken of a/^, where g is an even 
continuous real- valued function on M" with support in [—1, 1]". The just-mentioned trick is 
to take two independent measurements at each point, multiply the two, and use the resulting 



quantities in place of the measurements of 'g considered earlier. Thus instead of (81) above 
we have, for r 



1,2, measurements 



_(r) 



(r) 
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of \/'g^ for z G {o} U Z^(+), where satisfies (80) and where the -^^'^'s are row- wise in- 

dependent (i.e., independent for fixed k) zero mean random variables with uniformly bounded 
fourth moments. Then we replace g^^k in (81) by 



(110) 
Setting g 



(1)^(2) 
z,k ■ 



jk 



9Koz^„k and X 



jk 



Xz-^^k) the same notation and analysis that gave (83), but 



now using (82) and (110), leads instead to 

Mk{x) = gKoix) + Nk{x) - dk{x) 

where 



:ill) 



is an estimate of gxoi^ 
(112) 

1 



Mk(x) 



1 " 

— y 



cos{zjk ■ x)g^j. 



{27ik^y 



g]^{zjk/ki)cos{zjk-x) [X 



'(1) 



(2) 



jk 



{2Tik^y 



J2 cos(z,fc-a;)X«xg,) 



is a random variable, and the deterministic error dk{x) is given as before by (86). 
For our analysis it will be convenient to let 

1 

(113) 



Nkiix) 



and 

(114) 



(27rA;T)" 



Nk2ix) 



'-k 

E 

i=-i'k 



g]^{zjk/k^) cos{zjk ■ x) 



^jk +^jk 



{2-Kk 



7 P 



co^{z,k ■ x)xf^ Xf^ , 



so that Nk{x) = Nki{x) + Nk2{x). 

To keep the exposition brief, we shall not give a formal presentation of our algorithms, 
called Algorithm NoisyModLSQ, Algorithm NoisyModBlaschke, and Algorithm 
NoisyModDiff((p), since they are very similar to Algorithm NoisyMod^LSQ, Algorithm 
NoisyMod^Blaschke, and Algorithm Noisy Mod^Diff (</)), respectively. In each case the input 
is as before, except that instead of (94), (99), and ( 105[ ), we now have measurements 



_(r) 

9lk 



+ ^ik ' 



I'^KoiZik) 

for r = 1, 2, of the modulus of the Fourier transform of the characteristic function of Kq, where 

(r) 

the A-y's are row-wise independent zero mean random variables with uniformly bounded 
fourth moments. The task is the same in each case. For the actions, we first let g^j^ = glk'9ik^ 
and then follow the actions of the appropriate algorithms in the previous section, replacing ^ 
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by g. Thus in the action of each algorithm, we replace Mk{x) by Mfc(x) defined by (111), for 
the appropriate x. 



Theorem 9.1. Theorem 8J_ holds when Algorithm NoisyMod'^LSQ is replaced by Algorithm 
NoisyModLSQ. 

Proof. In the action of Algorithm NoisyModLSQ, the measurements used in Al gorithm Noisy- 

— /[,, . . . where M^^Xik) is given by (111) with x = Xik- 



CovLSQ are now Mk{xik)^ i 
Thus we have 

MJxik 



where Mk{xik) is given by (111) with x 

gKoixik) + Nk{xik) - dk{xik), 



i = — /^,...,/[, where Nk{xik) and dk{xik) are given by (112) and (86), respectively, with 



We claim that Lemma |8.2| holds when Nk{xik) is replaced by Nk{xik)- To see this, use the 

1/2 



triangle inequality to obtain 



'A- 

" i=-r, 



k{Xik)' 



< 



< 



- V Nkix^kf 
Ik — 



Lk 

% = — I 



1/2 



1/2 



\ '= \ /I 

- NkliXikY + [y,Y1 ^k2{Xikf 



t=—I 



where Nki{xik) and Nk2ixik) are given by (113) and (114), respectively, with x = Xik- Since 
is bounded, the same analysis as in the proof of Lemma 8.2, up to a constant, applies to 
the first of the two sums in the previous expression. So it suffices to prove that, almost surely, 



1 



k2iXik) 0, 



as — 7- oo. As in the proof of Lemma [8. 2 [ it is enough to show that, almost surely, 

1 



2n 



(^pqkXpk x'-pk X^qk ^fk 0' 



p,g=l 



as /c — )■ oo. This follows from Lemma 7.3 and proves the claim. 

With this in hand, we can conclude exactly as in the proof of Theorem 8.1 that Algorithm 
NoisyCovLSQ works with the new measurements under the same hypotheses. □ 



We remark that the computation of E(Zk) in Lemma 7.3 shows why we take two inde- 
pendent measurements of \/gK^ and multiply, rather than taking a single measurement and 
squaring it. In the latter case we would be led to 



{2'Kk"<) 



p,q=l 



50 GABRIELE BIANCHI, RICHARD J. GARDNER, AND MARKUS KIDERLEN 

which may be unbounded as /c — > oo. 



Theorem 9.2. Theorem 8j_3 holds when Algorithm NoisyMod"^ Blaschke is replaced by Algo- 
rithm NoisyModBlaschke. 



Proof. We now have 



where is as in (|102|) and 
(115) 



ik 



Nk{o) - Nk{hkU^) 



hi 



Vik — Cik + Tik, 



Nki{o) - Nki ihkUj) ^ NjAp) - Nk2{hkUi 



h 



hi 



for i = 1, . . . , fc, where A^fci and Nk2 are given by (113) and (114). The proof of Theorem 
can be followed, except that for Lemma 5^, one now shows that, almost surely, 

k 



8.3 



Vi 



1=1 







as A; — 7- oo. Using the fact that the earlier analysis applies to A^^i, and using also the triangle 
inequality, as we did in the proof of Theorem 9.1 , with ( 115 ), we see that it suffices to examine 

1 



2n 



E ^{1) ^(2) ^(1) ^(2) 
"-pqk^pk ^pk ^qk ^qk ' 



p,<j=l 



where Qpqk is given by (104). Then Lemma 7.3 shows that it is possible to choose 7 and e 
exactly as in Theorem |8. 3 to ensure that Lemma 5^ holds. No further changes are required, so 
Algorithm NoisyCovBlaschke works with the new measurements under the same hypotheses 
as in Theorem 18. 3[ □ 



Theorem 9.3. Theorem 8.4 holds when Algorithm NoisyMod'^Diff(ip) is replaced by Algorithm 
NoisyModDiff(ip). 



Proof. Note that by (112), we have E(Nk{xik)) = for all i and k. Therefore the same 
calculations as in the proof of Theorem 8.4 show that the second statement in Lemma 6.1 still 
holds. 

In Lemma [6l2 , it is enough in view of the proof of Theorem 8.4 to consider the contribution 

to gk{x) - E{gk{x)) from Nk2{xik), namely. 



(27rA;T)' 



x) cos{zjk ■ Xik)Xj^''Xji} . 



This allows the same estimate as before, up to a constant. No further changes are required, 
so Algorithm NoisyCovDiff((/?) works with the new measurements under the same hypotheses 
as in Theorem 18. 4[ □ 
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The previous result provides a convergence rate for Algorithm NoisyModDiff((y9) arbi trarily 

-l/4+3/{8n) 



8.4 



If we 



close to /;;-i/4+ii/(8"}^ ag -^yag noted for Algorithm Noisy Mod ^Diff((y9) after Theorem 
assume instead that the random variables Xj^ in Algorithm NoisyModDiff((/?) are row-wise 
independent, zero mean, and satisfy (75) and (76), that 7 > 1/2, and that (109) hol ds, then 
a rate arbitrarily close to can be obtained by the methods outlined in Remark 6.6 



10. Appendix 

10.1. Convergence rates. Rates of convergence for Algorithm NoisyCovDiff((y9), and hence 
for the two related algorithms for phase retrieval, are provided in Corollary |6.5| and Re- 



mark [6^ For the other algorithms, however, rates of convergence are more difficult to obtain. 
To explain why, it will be necessary to describe some results from |23], where convergence 
rates were obtained for algorithms for reconstructing convex bodies from finitely many noisy 
measurements of either their support functions or their brightness functions. The algorithms 
are called Algorithm NoisySupportLSQ and Algorithm NoisyBrightnessLSQ, respectively. 

In [21], an unknown convex body K is assumed to be contained in a known ball i? > 0, 
in M". An infinite sequence in S"""^ is selected, and one of the algorithms is run with 
noisy measurements from the first k directions in the sequence as input. The noise is modeled 
by Gaussian A^(0, cj^) random variables. With an assumption on {ui) slightly stronger than 
the condition that it is evenly spread (but still mild and satisfied by many natural sequences), 
and another unimportant assumption on the relation between R and cr, it is proved in [231 
Theorem 6.2] that if Pk is the corresponding output from Algorithm NoisySupportLSQ, then, 
almost surely, there are constants C = C{n, {ui)) and = N{a, n, R, (wj)) such that 

(116) 62{K, Pk) < C ^4/(n+3)^(n-l)/(n+3)^-2/(n+3)^ 

for k > N, provided that the dimension n < A. Here 62 is the L2 metric, so that 62{K,Pk) = 
Whx — hp^.\\2, where || ■ II2 denotes the L2 norm on S^~^. Convergence rates for the Hausdorff 
metric are then obtained by using the known relations between the two metrics. 

It is an artifact of the method that while convergence rates can also be obtained for n > 5, 
neither these nor those for the Hausdorff metric are expected to be optimal. In contrast, it has 



recently been proved by Guntuboyina [28j that the rate given in (116) for n < 4 is the best 
possible in the minimax sense. With the additional assumption that K is o-symmetric, corre- 
sponding rates for Algorithm NoisyBrightLSQ are obtained in [2H Theorem 7.6] from those 
for Algorithm NoisySupportLSQ by exploiting ^ and the Bourgain-Campi-Lindenstrauss 
stability theorem for projection bodies. 



There are two principal ingredients in the proof of ( |116 ). The first is [211 Corollary 4.2], a 



corollary of a deep result of van de Geer [I8l Theorem 9.1]. This corollary provides convergence 
rates for least squares estimators of an unknown function in a class Q, based on finitely many 
noisy measurements of its values, where the noise is uniformly sub-Gaussian. The result and 
the rates depend on having a suitable estimate for the size of Q in terms of its e-entropy 
with respect to a suitable pseudo-metric. The second ingredient is a known estimate (see 



52 



GABRIELE BIANCHI, RICHARD J. GARDNER, AND MARKUS KIDERLEN 



Proposition 5.4]) of the e-entropy of the class of support functions of compact convex sets 
contained in 5", with respect to the Loo metric. 

It should be possible to apply this method to obtain convergence rates for Algorithm Noisy- 
CovBlaschke and the two related algorithms for phase retrieval. With Gaussian noise, or more 
generally uniformly sub-Gaussian noise, this requires a modification to [48^ Theorem 9.1] that, 
in our situation, allows (53) to be used instead of the same inequality without the term c^k. 
(Compare |^ (9.1), p. 148].) This would yield the same convergence rates given in |2H The- 
orem 7.6] for Algorithm NoisyBrightLSQ. To cover the case of Poisson noise, however, one 
can make the general assumption that the random variables are row- wise independent, zero 
mean, and satisfy (75) and (76), as in Remark 6.6 This creates considerable further technical 
difficulties. It may well be possible to overcome these, using the machinery behind another 
result of van de Geer [HI Theorem 9.2]. But, as van de Geer points out in [HI p. 134], there 
is a price to pay: One now requires a uniform bound on the class Q of functions, as well as 
estimates of e-entropy "with bracketing." The former condition might be dealt with by ( [49) ), 
which implies that the sets liQk are uniformly bounded for any fixed realization. It should 
also be possible to obtain the latter, by combining suitable modifications of the bracketing 
argument of Lemma 4.6 and of the proof in [2Jl Theorem 7.3] of the e-entropy estimate for 
the class of zonoids contained in B^. 

But we have not carried out a complete investigation into convergence rates for Algo- 
rithm NoisyCovBlaschke and the related algorithms for phase retrieval, despite having a strat- 
egy for doing so, described in the previous paragraph. The main reason is that there are more 
serious technical obstacles in achieving convergence rates for Algorithm NoisyCovLSQ, even 
for the case of Gaussian noise. In principal, the method outlined above could be applied by 
taking Q to be the class of covariograms of compact convex subsets of the unit ball in M". 
However, an estimate would be required of the e-entropy of this class with respect to the L^o 
metric or some other suitable pseudo-metric. Even if this were available, an application of 
the theory of empirical processes as described above would yield convergence rates not for 
52(K, Pk) but rather for Wqk — dPklU- To obtain rates for 62{K, Pk), one would then also need 
suitable stability versions of the uniqueness results for the Covariogram Problem described in 
the Introduction. In view of the difficulty of these uniqueness results, proving such stability 
versions will presumably be very challenging. 

In summary, a full study of convergence rates for the other algorithms proposed here must 
remain a project for future study. 



10.2. Implementation issues. The study undertaken in this paper is a theoretical one. 
Although we propose algorithms in enough detail to allow implementation, the laborious task 
of writing all the necessary programs, carrying out numerical experiments, and comparing 
with other algorithms, largely lies ahead. 

At the present time we only have a rudimentary implementation of Algorithms Noisy- 
CovBlaschke and NoisyCovLSQ. The programs were written, mainly in Matlab, by Michael 
Sterling-Goens while he was an undergraduate student at Western Washington University, and 
are confined to the planar case. Algorithm NoisyCovBlaschke seems to be very fast; this is 
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to be expected, since it is based on Algorithm NoisyBrightnessLSQ, which is also fast even in 
three dimensions. Behind both of these latter two algorithms is a linear least squares problem 



(cf. [251 (18) cLnd (19)]). In contrast, the least squares problem (18) in Algorithm NoisyCovLSQ 
is nonlinear. Preliminary experiments indicate that reasonably good reconstructions, such as 
those depicted in Figures [l]-[4] (based on Gaussian A^(0, cr^) noise, k = 60 equally spaced direc- 
tions in Algorithm NoisyCovBlaschke and A; = 8 in Algorithms NoisyCovLSQ), can usually 
be obtained in a reasonable time in the planar case. Occasionally, however, reconstructions 
can be considerably worse, particularly for regular m-gons for very small m. Better and faster 
reconstructions, also in higher dimensions, will probably require bringing to bear the usual 
array of techniques for nonlinear optimization, such as simulated annealing. 
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Figure 1. Pentagon, no noise 
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Figure 2. Pentagon, a = 0.01 
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Figure 3. Ellipse, no noise 
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Figure 4. Ellipse, a = 0.01 



it is important to control the number 
the number of facets of the approximation to the Blaschke body 



Since the least squares problem (18) is nonlinear, 
of variables, that is, 

VKq of Kq. To a large extent. Algorithm NoisyCovBlaschke already does this; the potential 
0(/c"^^) variables that would otherwise be required (see [211 p. 1335]) is, as experiments show. 
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considerably reduced. In fact, if there is little or no noise, a linear programming version of the 
brightness function reconstruction program due to Kiderlen (see [251 P- 289], where it is stated 
for measurements without noise) is not only even faster, but also produces approximations 
Qk to VKq with at most 2k facets. Beyond this, there is the possibility of using the pruning 
techniques discussed in [HI Section 3.3]. 

There is also the possibility of changing the variables in the least squares problem ( |I8| . A 
convex polytope P whose facet outer unit normals are a subset of a prescribed set {iwj : j = 
1, . . . , s} of directions can be specified by the vector h = {hf, , . . . , hf, h~) such that 

P = P(h) = {x eW : -hj <x-Uj< hj,j = 1, . . . , s}. 

The possible advantage in using these variables arises from the fact that, by the Brunn- 
Minkowski inequality (cf. [211 Section 11]), the covariogram gp{h){x) turns out to be {1/n)- 
concave (i.e., gp(h){xY^^ is concave) on its support in the combined variable {h,x). One may 
therefore try solving the problem 

h 

(117) min^ [Mik - gp{h){xik)) 



1=1 



over the variables hJ ,hi , . . . ,hf , h~ . By expanding the square in (117), approximating the 
sums by integrals, and using the Prekopa-Leindler inequality [2U Section 7], the objective 
function can be seen as an approximation to the difference of two log-concave functions. 
These admittedly weak concavity properties may help. 

Regularization is often used to improve Fourier inversion in the presence of noise. We 
expect this to be of benefit in implementing the phase retrieval algorithms, where preliminary 
investigations indicate that regularization will allow the restriction on the parameter 7 to be 
considerably relaxed. 

Corresponding to the two basic approaches to reconstruction — one via the Blaschke body 
and one via the difference body — there are two different sampling designs. For the former, 
measurements are made first at the origin and at points in a small sphere centered at the 
origin, and then again at points in a cubic array. For the latter, measurements are made 
twice, each time at points in cubic array. These sampling designs are a matter of convenience, 
at least regarding the cubic array. It should be possible to use a variety of different sets 
of measurement points, at least for reconstructing from covariogram measurements, with 
appropriate adjustments in the consistency proofs. 
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